Editing system, editing method, clip management device, and clip management method

ABSTRACT

The relation between the edit resultant clip and the clip to be edited is managed with the hierarchical structure by managing means, so that the complicate editing works can be easily performed if the editing works are performed based on the information stored in the managing means.

TECHNICAL FIELD

[0001] The present invention relates to an editing system, and moreparticularly, is applicable to an editing system for performing editprocessing by using a plurality of materials.

BACKGROUND ARTS

[0002] Recently, in the field of postproduction which edits the videodata obtained from a video camera, a nonlinear editing system whichuses; a disc as a recording medium for recording the data of materialshas been proposed. There are various types of edit processing as anediting processing performed in the nonlinear editing system. Forexample, they are the video edit processing for combining a plurality ofmaterials to produce a desired video program, the composite processingfor composing a plurality of materials by key signal, the special effectprocessing for applying the special effects to materials, and so on.Generally, the video edit processing is performed at an editing device,the composite processing is performed at a video switcher, and thespecial effect processing is performed at a special effect device.

[0003] In recent years, the development of a disc recording medium inits random access function makes it possible to access to a plurality ofchannels simultaneously. As a result, the edit processing for processingvideo data of a plurality of channels in real time has been desired. Forexample, in the television world in which television commercial messagesare :edited and produced or in the movie world in which movie programsare edited and produced, it is desired to use a dozens of materials toseveral hundred materials and to combine some different editprocessings. More over, it is required to produce a complicated and highdegree of edit resultant data by performing the several kinds of editprocessing repeatedly.

[0004] To produce the complicated and high degree of edit resultantdata, it is needed to control a dozen of materials to several hundredmaterials and to store the history of the edit processing.

[0005] However, in a conventional editing system, there is no device forcontrolling a lot of materials and no device for storing the edithistory, so that the editing operation has became complicated. Morespecifically, an edit operator (hereinafter, referred to as “operator”shortly) can not remember the information that which material has beenused and which edit processing has been performed when the editresultant video data has been produced. Therefore, in the conventionalediting system, the operator has managed the information by writing in apaper whenever the editing is performed. Further, in the case of thecomplicated edit processing such that a newly edit resultant video datais repeatedly produced from a plurality of edit resultant video data,the information of the editing history that which of materials is thefinal edit resultant video data produced from becomes large size ofdata, so that it has been impossible for the operator to manage theinformation by writing in a paper.

[0006] Also, in the conventional editing system, the operator needs tooperate the device corresponding to the edit processing for each editprocessing. Therefore, the edit works become complicated terribly. Forinstance, when two video data are composed, the operator needs tooperate a control panel connected to a switcher device. When the specialeffect is applied to video data, the operator needs to operate a keyboard of the special effect device. There has been a problem that thedevice to be operated is changed in accordance with the edit processingso as to take much time to edit.

DISCLOSURE OF INVENTION

[0007] This invention is to solve the problems described above, and toprovide an editing system which can realize the simplified andhigh-speed edit by managing a plurality of materials with the originalhierarchical structure. Further, based on the management information,this invention is to realize the simplified and high-speed edit bymanaging a plurality of materials to be the most suitable for the editprocessing.

[0008] Further, this invention is to provide an editing system which canperform various edit processings such as the edit processing, compositeprocessing and special effect processing by manipulating one computerwithout operating respective devices by an operator. Also, thisinvention is to provide an editing system for producing the complicatedand high degree of edit resultant data which can not be realized by aconventional editing system. Furthermore, this invention is to providean editing system having the optimum Graphical User Interface (GUI) tomanage a plurality of materials with the hierarchical structure and toproduce the complicated and high degree of the edit resultant data. TheGUI simplifies the edit works and improves the usage of the editoperation.

[0009] To solve the above problems, according to this invention, anediting system for producing the edit resultant clip from a plurality ofclips to be edited is provided with editing means, which consists of aplurality of processing modules for editing the clips to be edited, forproducing the edit resultant clip by performing the edit processingcorresponding to the processing module selected among from the pluralityof processing modules on the plurality of clips to be edited, managingmeans for managing with the hierarchical structure the edit resultantclip and the plurality of clips to be edited in order to show that whichof clips to be edited is the edit resultant clip produced from, andcontrol means for controlling the editing means based on the informationmanaged by the managing means.

[0010] The relation between the edit resultant clip and the clips to beedited can be obtained by managing means. Thus, the edit resultant clipis produced based on the information showing the relation between theclips kept in the managing means, so as to perform the complicated editworks easily.

[0011] Further, according to this invention, the editing system forediting a plurality of clips to be edited is provided with editingmeans, which consists of a plurality of processing modules for editingthe clips to be edited, for producing the edit resultant clip byperforming the edit processing corresponding to the processing moduleselected among from the plurality of processing modules on the pluralityof clips to be edited, display means for displaying the graphical userinterface corresponding to the plurality of processing modules on adisplay, storing means for storing image processing data showing thecontent of image processing performed by the edit processing applied tothe video data of the clips to be edited, correspondingly to the editresultant clip, and control means for controlling the display means todisplay the image processing data stored in the storing means whichcorresponds to the selected edit resultant clip on a display as a partof the graphical user interface when the edit resultant clip isselected.

[0012] When the edit resultant clip is selected, the image processingdata showing the content of the image processing is displayed on adisplay as a part of the graphical user interface, so that the editoperator looks at the display to understand the content of the specifiedimage processing easily.

BRIEF DESCRIPTION OF DRAWINGS

[0013]FIG. 1 shows a block diagram showing the construction of anediting system according to the present invention;

[0014]FIG. 2 is a block diagram showing the internal construction of thework station being the main construction of the editing system;

[0015]FIG. 3 is a schematic diagram showing modules and clip databaseprovided in the editing system according to the present invention;

[0016]FIG. 4 is a schematic diagram explaining the hierarchicalmanagement of clips;

[0017]FIG. 5 is a schematic diagram explaining the image of compositeprocessing;

[0018]FIG. 6 is a screen image explaining the video image produced bythe composite processing;

[0019]FIG. 7 is a schematic diagram explaining the concept of thecomposite processing;

[0020]FIG. 8 is a schematic diagram explaining the concept of thespecial effect processing;

[0021]FIG. 9 is a schematic diagram explaining the concept of the editprocessing;

[0022]FIG. 10 is a screen image showing the GUI screen displayed whenthe composite module is started up;

[0023]FIG. 11 is a screen image showing the GUI screen displayed whenthe special effect module is started up;

[0024]FIG. 12 is a screen image showing the GUI screen displayed whenthe edit module is started up;

[0025]FIG. 13 is a table showing a database for clip management dataregistered in a clip database;

[0026]FIG. 14 is a table explaining the database when the clipmanagement data which already has been registered is modified;

[0027]FIG. 15 is a table showing the editing point data in the compositeprocessing;

[0028]FIG. 16 is a table showing the editing point data in the specialeffect processing;

[0029]FIG. 17 is a table showing the editing point data in the editprocessing;

[0030]FIG. 18 is a table showing the composite data in the compositionprocessing;

[0031]FIG. 19 is a table showing the special effect data at the specialeffect processing;

[0032]FIG. 20 is a table showing the editing data in the editprocessing;

[0033]FIG. 21 is a flowchart explaining the operation when the controlmodule is started up;

[0034]FIG. 22 is a flowchart explaining the operation when the editmodule is started up;

[0035]FIG. 23 is a flowchart explaining the operation when the compositemodule is started up;

[0036]FIG. 24 is a flowchart explaining the operation when the specialeffect module is started up;

[0037]FIG. 25 is a flowchart explaining the operation in the editionprocessing;

[0038]FIG. 26 is a schematic diagram explaining an arbitrary resultantclip when the content of edit is modified;

[0039]FIG. 27 is a flowchart explaining the operation when the othermodule is started up during a predetermined module has been started up;

[0040]FIG. 28 is a flowchart explaining the operation in there-execution processing; and

[0041]FIG. 29 is a schematic diagram showing the re-execution processingschematically.

BEST MODE FOR CARRYING OUT THE INVENTION

[0042] (1) The Whole Construction of Editing System

[0043] First, the whole construction of the editing system of thisinvention will be described referring to FIG. 1.

[0044] In FIG. 1, 1 shows the editing system according to thisinvention, which has a work station 2 for controlling the systementirely. The work station 2 has a body 2A provided with a centralprocessing unit (CPU), various processing circuits, a floppy disc drive,a hard disk drive, and so on, a display 2B connected to the body 2A, akey board 2C, a mouse 2D, and a pen tablet 2E. In the work station 2, anapplication software for editing has been previously installed in thehard disk drive. The application software is operated under theoperating system, so as to start up as a computer for editing.

[0045] In connection, when the application software is operated, thegraphic display for the graphical user interface (GUI) is displayed onthe display 2B. If a desired graphic display displayed on the display 2Bis selected by using the pen tablet 2E or the mouse 2D described above,the desired edit command can be input to the work station 2. Variousnumeral data relating to edit can also be input to the work station 2through the key board 2C.

[0046] In addition, when the edit command or various numeral data isinput by an operator, the work station 2 outputs control data inaccordance with the edit command or various numeral data to a devicecontroller 3 described later. In this way, respective devices composingthe editing system 1 are controlled through the device controller 3.However, a part of the function of a video disk recorder 5 is directlycontrolled without the device controller 3.

[0047] Further, video data is input to the work station 2 through thedevice controller 3, so that the image of edit material or the imageafter edit can be displayed on the display 2B.

[0048] The device controller 3 is a control device for receiving thecontrol data from the work station 2 and actually controlling respectivedevices. The exclusive controller 4 having dial operation keys or slideoperation keys is connected to the device controller 3, so that thegradually-changing control data which can not be input from the keyboard 2C, the mouse 2D, or the pen tablet 2E of the work station 2 canbe also input in the editing system 1.

[0049] The device controller 3 receives the control data from the workstation 2 or the exclusive controller 4 to control the devicescorresponding to the control data. For example, the device controller 3instructs the video disk recorder 5 to reproduce a material and recordthe material after edit. The video disk recorder 5 instructed reproducesthe video data or audio data of the desired material which has beenstored in the internal disc recording medium to output it, and recordsthe edited video data or audio data in the disc recording medium, inaccordance with the instruction.

[0050] Similarly, the device controller 3 instructs the video taperecorder (VTR) 6 to reproduce a material. The instructed video taperecorder 6 reproduces the video data or audio data of the desiredmaterial which has been stored in the internal video tape to output it,in accordance with the instruction. In addition, in the editing system1, the video data recorded in the video tape recorder 6 is manipulatedas video data of the material, after being down-loaded once in the videodisk recorder 5.

[0051] Further, the device controller 3 instructs the switcher 7 toselect the video data output from the video tape recorder 6 or a videocamera 8. The instructed switcher 7 selects the input video data of thedesired material to output it to a digital multi-effector 9 and tooutput to the work station 2 through the device controller 3,successively selects the input video data of the desired video data tocombine them, or outputs the edited video data to display it on amonitor 10, and returns the edited video data to the video disk recorder5 to record it, in accordance with the instruction.

[0052] Further, the device controller 3 instructs the digitalmulti-effector 9 to perform various effect processing. The instructeddigital multi-effector 9 performs on the input video data of the desiredmaterial the special effect processing such as the mosaic processing andthe three-dimensional transform processing, effect processing such asthe transition effect, and the image composite processing. The obtainedvideo data is returned to the switcher 7 again and is output to the workstation 2, the monitor 10, and the video disk recorder 5, in accordancewith the instruction.

[0053] Further, the device controller 3 instructs an audio mixer 11 toedit the audio data output from the video disk recorder 5 or the videotape recorder 6. The instructed audio mixer 11 composes (mixes) thedesired audio material, and returns the composed audio data to the videodisk recorder 5 to be recorded, in accordance with the instruction.

[0054] In this way, in the editing system 1 having the constructiondescribed above, the desired edit command is input through the workstation 2, so that the complicated and high-degree of desired video datacan be produced easily by using the video data of a plurality of variousmaterials which have been recorded in the video disk recorder 5 or thevideo tape recorder 6. Thus, if an operator does not directly operaterespective devices consisting the editing system, the various edits canbe performed by only operating the work station 2. Therefore, the worksof edit can be reduced comparing to the conventional system, and theusage of the editing system can be improved.

[0055] (2) The Construction of the Work Station

[0056] In this paragraph, the construction of the work station 2 whichis the central existence of the editing system 1 will be described. Asshown in FIG. 2, the work station 2 has a system bus 20 for transmittingthe command data and the video data, a CPU 21 for controlling the workstation 2 entirely, a video processor 22 for performing image processingon the video data S1 supplied from the device controller 3, a displaycontroller 23 for managing the video data displayed on the display 2Band the graphic display for the GUI, an HDD interface 24 for controllinga local hard disk drive (local HDD) 24A, a FDD interface 25 forcontrolling a floppy disc drive (FDD) 25A, a pointing device interface26 for producing the control command based on the command input from thepointing device such as the key board 2C, the mouse 2D, and the pentablet 2E, and an external interface 27 having the software driver foroutputting the control data S2 to the device controller 3.

[0057] The system bus 20 is a bus to transmit the video data, commanddata, address data, etc. in the work station 2, and is composed of animage data bus 20A for transmitting the video data and a command databus 20B for transmitting the command data and the address data.

[0058] The CPU 21, the video processor 22, the display controller 23,the HDD interface 24, and the FDD interface 25 are connected to theimage data bus 20A. The CPU 21, the video processor 22, the displaycontroller 23, the HDD interface 24, and the FDD interface 25 transmitthe video data through the image data bus 20A.

[0059] On the other hand, the CPU 21, the video processor 22, thedisplay controller 23, the HDD interface 24, the FDD interface 25, thepointing device interface 26, and the external interface 27 areconnected to the command data bus 20B (that is, all blocks in the workstation 2 are connected). The command data and the address data aretransmitted through the command data bus 20B.

[0060] The CPU 21 is a block for controlling the work station 2entirely, and has a ROM 21A in which the operating system of the workstation 2 is stored and a RAM 21B in which the up-loaded applicationsoftware and database are stored. To start up the work station 2, theCPU 21 operates based on the operating system stored in the ROM 21A soas to start up it. To drive the application software under the operatingsystem started up, the CPU 21 firstly reads the application softwarerecorded in the hard disk of the hard disk drive 24A to up-load it onthe RAM 21B, thereafter, the application software is executed to bedriven.

[0061] In addition, the application software is divided into modulesaccording to their function. As described later, when roughly divided,the application software is composed of the edit module for combiningthe materials, the composite module for composing the materials suchlike superimposing, the special effect module for applying specialeffects to the materials such like the three-dimensional transform, andthe control module for controlling the starting up of the modules andthe data transfer. More specifically, in the system, when theapplication software is started up, firstly the control module isstarted up. Then, when the instruction is input from an operator toedit, the corresponding module is suitably started up under the controlof the control module, so as to perform the edit instructed by theoperator.

[0062] The video processor 22 is a block for receiving the video data S1of the Serial Digital Interface (SDI) standard input to the work station2 and converting the video data S1, which is buffered temporarilytherein. More specifically, the video processor 22 is composed of aprocessor controller 22A for controlling the video processor entirely, adata converting part 22B for extracting the composite video signal fromthe pay load part of the received video data S1 and for converting thecomposite video signal into the digital component video data, and aframe memory 22C for storing the video data of several frames outputfrom the data converting part 22B temporarily.

[0063] The processor controller 22A outputs the control signal to thedata converting part 22B to control the data converting operation of thedata converting part 22B, and makes the data converting part 22B toextract time code from the video data S1. Further, the processorcontroller 22A outputs the control signal to the frame memory 22C tocontrol the read/write timing and the read/write address of the framememory 22C. In connection, as to the read timing, the processorcontroller 22A controls the read timing of the frame memory 22C so thatthe time code output to the display controller 23 corresponds to thevideo data (frame data).

[0064] The data converting part 22B converts the composite video signalinto the digital component video data based on the control signal fromthe processor controller 22A. In connection, the time code is extractedin this converting process. The obtained video data is output to theframe memory 22C as described above, and the extracted time code isoutput to the processor controller 22A.

[0065] The frame memory 22C stores the video data supplied from the dataconverting part 22B temporarily. The read/write timing of the framememory 22C is controlled by the processor controller 22A as describedabove. The frame memory 22C is composed of at least two frames, and canstore the video data for at least two frames.

[0066] The video data stored in the frame memory 22C is read out basedon the read control of the processor controller 22A. The all pixels ofthe video data stored in the frame memory 22C is not read out, but thedata is thinned out for each predetermined interval and read out so thatthe size of image is smaller than that of the original image. Theconverted video data having smaller size of image is output to thedisplay controller 23 through the image data bus 20A, in order to bedisplayed at the predetermined display area of the display 2B as animage for confirmation of the materials or edited result.

[0067] The display controller 23 is a block for controlling the data tobe displayed on the display 2B. The display controller 23 has a memorycontroller 23A and a video random access memory (VRAM) 23B. The memorycontroller 23A controls the read/write timing of the VRAM 23B inaccordance with the internal synchronization of the work station 2. Inthe VRAM 23, the video data output from the frame memory 22C of thevideo processor 22 and the image data produced by the CPU 21 are storedbased on the timing control signal from the memory controller 23A. Thevideo data and image data stored in the VRAM 23B are read out based onthe timing control signal from the memory controller 23A in accordancewith the internal synchronization of the work station 2, to be displayedon the display 2B.

[0068] At this time, the graphic display of the image data becomes tothe graphic display for the GUI. In connection, the image data outputfrom the CPU 21 to the VRAM 23B is the image data such as windows,cursor, scroll bars, and icons showing devices.

[0069] Thus, in the work station 2, the image data and the video dataare displayed on the display 2B, so that the GUI for the operator andthe image of materials or edited result are displayed on the display 2B.

[0070] The HDD interface 24 is an interface block for communicating withthe local hard disk drive 24A internally provided in the work station 2.The HDD interface 24 and the hard disk drive 24A communicate each otherbased on the transmission format of the Small Computer System Interface(SCSI).

[0071] The application software which is driven in the work station 2 isinstalled in the hard disk drive 24A. To execute the applicationsoftware, it is read out from the hard disk drive 24A to be up-loaded tothe RAM 21B. When the application software is terminated, variousinformation produced by the edit operation stored in the RAM 21B isdown-loaded to the hard disk via the hard disk drive 24A.

[0072] The FDD interface 25 is an interface block for communicating withthe floppy disc drive 25A internally provided in the work station 2. TheFDD interface 25 and the floppy disc drive 25A communicate each otherbased on the transmission format of the SCSI.

[0073] The pointing device interface 26 is an interface block forreceiving the information from the key board 2C, mouse 2D, and pentablet 2E which are connected to the work station 2. The pointing deviceinterface 26 receives the input information from the buttons provided onthe key board 2C to decode the received input information, and outputsit to the CPU 21. Similarly, the pointing device interface 26 receivesthe detection information of a two-dimensional rotary encoder providedin the mouse 2D and the click information of the left/right buttonsprovided on the mouse 2D (that is, the information selected andspecified by pushing down the buttons) to decode the receivedinformation, and outputs it to the CPU 21. Similarly, the pointingdevice interface 26 receives the two-dimensional positional data fromthe pen tablet 2E to decode the received positional data, and outputs itto the CPU 21. Based on these information output from the pointingdevice interface 26, the CPU 21 can understand which command button isinstructed among the GUI displayed on the display 2B, and understandvarious data input from the key board 2C, so as to perform thecorresponding control.

[0074] The external interface 27 is a block for communicating with thedevice controller 3 connected to the work station 2 externally. Theexternal interface 27 has a driver for converting various controlcommand such as reproduction command produced by the CPU 21 andrecording command into the data of a predetermined communicationprotocol, which outputs the control command data S2 to the devicecontroller 3 through the driver.

[0075] (3) The Principle of Edit in the Editing System

[0076] In this paragraph, the principle of edit in the editing system 1will be explained successively.

[0077] (3-1) Basic Construction of the Application Software for Edit

[0078] In this paragraph, the basic construction of the applicationsoftware for edit prepared in the work station 2 will be firstlyexplained. As shown in FIG. 3, in the editing system 1, the applicationsoftware for edit, which is divided into modules according to theirfunction, is prepared in the work station 2. When roughly divided, theapplication software divided into modules is composed of the edit moduleEM for editing a material such like combining, the composite module CMfor composing a material such like superimposing, the special effectmodule SM for applying special effects to a material, and the controlmodule CNTM for controlling the starting up of the edit module EM, thecomposite module CM, and the special effect module SM which are dividedinto modules according to their functions. When the application softwarehaving such construction is up-loaded from the hard disk drive 24A tothe RAM 21 b, firstly the control module CNTM is started up. Then, eachof the modules EM, CM, and SM is suitably started up under the controlof the control module CNTM in accordance with the instruction from anoperator.

[0079] A clip database CDB is composed of the video disk recorder 5 andthe RAM 21B, and stores the video data of materials and various datarelating to the edit. Each of the modules EM, CM, and SM reads out thematerial instructed by the operator from the clip database CDB, editsthe material in accordance with the instruction of the operator usingthe hardware such as the switcher 7 or the digital multi-effector 9described above, and registers the obtained material edited in the clipdatabase CDB. Each of the modules EM, CM, and SM also registers the datarelating to edit such as various parameters used for edit in the clipdatabase CDB. In addition, the clip database CDB mainly stores the videodata of the material in the video disk recorder 5, and stores variousdata relating to edit in the RAM 21B.

[0080] (3-2) Definition of Clip

[0081] In the editing system 1, each material is handled with a unitcalled clip. In this paragraph, the clip will be described. In theediting system 1 according to this invention, one sequence of the videomoving image data is defined as clip video data. Data for managinginformation that how the clip video data is produced is defined as clipmanagement data. Data consisting the clip video data and the clipmanagement data is defined as clip. Further, in the editing system 1according to this invention, a material produced by only cutting outfrom the source video data is called material clip (MC), and a materialproduced by editing the material clip is called resultant clip (FC).

[0082] In the editing system 1 according to this invention, a pluralityof clips composed of the material clips and the resultant clips aremanaged with the hierarchical structure based on the relation betweenclips. Referring to an example of FIG. 4, the state will be explainedbelow.

[0083] In the example of FIG. 4, the resultant clip FC-008 is a clipproduced by composing three material clips, the material clip MC-001,the material clip MC-002, and the material clip MC-003. That is, therelations between the resultant clip FC-008 and the material clipMC-001, the material clip MC-002, and the material clip MC-003 are inthe relation of up and low. In the relation of up and low, since thematerial clip MC-001, the material clip MC-002, and the material clipMC-003 are under the resultant clip FC-008, they are called lower clips.On the contrary, the resultant clip FC-008 is called upper clip becauseit is produced by composing these lower clips.

[0084] Similarly, the resultant clip FC-009 is a clip produced byapplying the special effect to the material clip MC-004. Therefore, thematerial clip MC-004 is the lower clip of the resultant clip FC-009. Onthe contrary, the resultant clip FC-009 is the upper clip of thematerial clip MC-004.

[0085] Further, the resultant clip FC-010 is a resultant clip producedby editing (in this case, combining by wipe, etc.) the resultant clipFC-008 and the resultant clip FC-009. Therefore, the resultant clipFC-008 and the resultant clip FC-009 are respectively the lower clips ofthe resultant clip FC-010. The resultant clip FC-010 is the upper clipof the resultant clip FC-008 and the resultant clip FC-009.

[0086] In this way, the relation of up and low exists between respectiveclips. In the editing system 1, each clip is managed with thehierarchical structure based on the relation of up and low between clipsin the clip database CDB. In connection, the material clip which is notused for edit have no relation with the other clips. However, thematerial clip is managed as a clip having no object to link. The exampledescribed here is one example and other combinations also exist as therelation of up and low between clips.

[0087] (3-3) General Idea of the Composite Processing

[0088] Next, in this paragraph, the general idea of the Compositeprocessing performed in the composite module CM will be explained. Thevideo image of the resultant clip FC-008 shown in FIG. 4 is produced bycomposing (that is the composite processing) the video images of thematerial clip MC-001, the material clip MC-002, and the material clipMC-003. The general idea of the composite processing is shown in FIG. 5and FIG. 6. FIG. 5 shows the state of composing the video images ofthree material clips MC-001, MC-002, and MC-003. FIG. 6 shows the videoimage of the resultant clip FC-008 produced by composing.

[0089] In the editing system 1 according to this invention, in the caseof composing a plurality of clips, each clip is regarded as one layer,and the layers are piled up so as to compose. In the example of FIG. 5,the material clip MC-003 is specified as the first layer L1, thematerial clip MC-002 is specified as the second layer L2, and thematerial clip MC-001 is specified as the third layer L3. In the case ofcomposing the material clips assigned to respective layers L1, L2, andL3, the layer L1 is the lowest layer, and respective layers L2, L3 aresuccessively piled up thereon. More specifically, the video image of thematerial clip MC-002 (e.g., image showing a human) specified as thesecond layer L2 is piled on the video image of the material clip MC-003(e.g., image showing background) specified as the first layer L1 tocompose them, and the video image of the material clip MC-001 (e.g.,image showing characters) specified as the third layer L3 is furtherpiled up on the composed video image so as to compose them. By thiscomposite processing, the resultant clip FC-008 of the video image suchthat three materials are superimposed as shown in FIG. 6 can beproduced.

[0090] In addition, FIG. 5 shows the example of composing the materialclips MC-003, MC-002, and MC-001 respectively assigned to three layerL1, L2, and L3. However, the editing system 1 of this invention can saveten layers at maximum, and can compose ten material clips respectivelyassigned from the first layer L1 to tenth layer L10. In connection, inthis case, the first layer L1 is the lowest layer, and the tenth layerhaving the largest layer number is the uppermost layer.

[0091] Next, referring to FIG. 7, the composite processing will befurther explained with more details. FIG. 7 shows the state that theresultant clip FC-008 is produced by composing the material clip MC-003specified as the first layer L1, the material clip MC-002 specified asthe second layer L2, and the material clip MC-001 specified as the thirdlayer L3. As shown in FIG. 7, in the resultant clip FC-008, the firstediting point EP1 to the eighth editing point EP8 are set as an editstart point of each material clip (which is referred to as in-point), anedit end point (which is referred to as out-point), and points forchanging parameters of the composition and the image conversion.

[0092] The first editing point EP1 indicates the in-point IN3 of thematerial clip MC-003, the second editing point EP2 indicates thein-point IN2 of the material clip MC-002, the fourth editing point EP4indicates the in-point IN1 of the material clip MC-001. Further, thesixth editing point EP6 indicates the out-point OUT2 of the materialclip MC-002, the seventh editing point EP7 indicates the out-point OUT1of the material clip MC-001, and the eighth editing point EP8 indicatesthe out-point OUT3 of the material clip MC-003. In addition, the thirdediting point EP3 and the fifth editing point EP5 are the editing pointsset for changing the composite parameter of each layer. The editingpoints EP3 and EP5 will be described in details later.

[0093] As shown in FIG. 7, each clip has the original internal time codestarting from the head position of the video data of each clip. Forexample, the material clip MC-003 specified as the first layer L1 hasthe internal time line t3 starting from the head position S3 of thevideo data, the material clip MC-002 specified as the second layer L2has the internal time line t2 starting from the head position S2 of thevideo data, and the material clip MC-001 specified as the third layer L3has the internal time line t1 starting from the head position S1 of thevideo data.

[0094] Similarly, the resultant clip FC-008 has the internal time linet8 starting from the head position S8 of the video data. The time codesof the first editing point EP1 to the eighth editing point EP8 arerespectively defined by the time codes on the time lines t8 of theresultant clip FC-008.

[0095] The in-point IN3 and out-point OUT3 of the material clip MC-003are defined by the time line t3 of the material clip MC-003, and theirtime codes are “00:00:31:02” and “00:05:18:02” respectively.Accordingly, the time code of the in-point IN3 corresponds to the timecode “00:00:00:00” of the first editing point EP1 in the resultant clipFC-008, and the time code of the out-point OUT3 corresponds to the timecode “00:04:47:00” of the eighth editing point EP8 in the resultant clipFC-008.

[0096] Similarly, The in-point IN2 and out-point OUT2 of the materialclip MC-002 are defined by the time line t2 of the material clip MC-002,and their time codes are “00:00:51:00” and “00:03:04:20” respectively.Accordingly, the time code of the in-point IN2 corresponds to the timecode “00:00:42:20” of the second editing point EP2 in the resultant clipFC-008, and the time code of the out-point OUT2 corresponds to the timecode “00:02:59:20” of the sixth editing point EP6 in the resultant clipFC-008.

[0097] Similarly, The in-point IN1 and out-point OUT1 of the materialclip MC-001 are defined by the time line t1 of the material clip MC-001,and their time codes are “00:01:40:03” and “00:02:45:48” respectively.Accordingly, the time code of the in-point IN1 corresponds to the timecode “00:01:56:00” of the fourth editing point EP4 in the resultant clipFC-008, and the time code of the out-point OUT1 corresponds to the timecode “00:03:19:45” of the seventh editing point EP7 in the resultantclip FC-008.

[0098] Therefore, when the resultant clip FC-008 is reproduced, thevideo image of the material clip MC-003 is output during the period fromthe first editing point EP1 to the second editing point EP2. The videoimage of which the material clip MC-002 is composed on the material clipMC-003 is output during the period from the second editing point EP2 tothe fourth editing point EP4. The video image of which the material clipMC-002 and the material clip MC-001 are composed on the material clipMC-003 is output during the period from the fourth editing point EP4 tothe sixth editing point EP6. The video image of which the material clipMC-001 is composed on the material clip MC-003 is output during theperiod from the sixth editing point EP6 to the seventh editing pointEP7. Then, the video image of the material clip MC-003 is output duringthe period from the seventh editing point EP7 to the eighth editingpoint EP8.

[0099] In addition, the example described here is one example and othercombinations also exist as a combination of clips to be composed.

[0100] (3-4) General Idea of the Special Effect Processing

[0101] Next, in this paragraph, the general idea of the special effectprocessing which is performed in the special effect module SM will beexplained. The resultant clip FC-009 shown in FIG. 4 is a clip producedby applying the special effect to the material clip MC-004. In order tomake it easy to understand, four special effects, the mosaic effect, thecrop effect, the three-dimensional transform, and the trail effect areapplied to the material clip MC-004, and the general idea of the specialeffect processing is explained referring to FIG. 8.

[0102] As show in FIG. 8, in this example, to the material clip MC-004,the mosaic effect is specified as the first special effect E1, the cropeffect is specified as the second special effect E2, thethree-dimensional transform is specified as the third special effect E3,and the trail effect is specified as the fourth special effect.

[0103] In this case, the mosaic effect is the effect that the videoimage is divided into tile pieces to show it like a mosaic picture. Inthe editing system 1 according to this invention, parameters relating tothe mosaic effect can be set to arbitrary values, so that the size of atile piece and the aspect ratio can be set to arbitrary values.

[0104] The crop effect is the effect that a part of the video image iscut out by reducing the picture frame, which is called the cut-outeffect because a part of the video image is cut out. In the editingsystem 1 according to this invention, parameters relating to the cropeffect can be set to arbitrary values, so that the position of the rightand left side of the picture frame, the position of the top and bottomside of the picture frame, and the gradation of the edges can be set toarbitrary values.

[0105] The three-dimensional transform is the effect that an image isvirtually transformed on the three-dimensional space. For example, it isthe image transform for rotating the image using the X-axis, Y-axis, andZ-axis as a shaft, and for transferring the image into the X-axis,Y-axis, or Z-axis direction, when the horizontal direction of the imageis defined as X-axis, the vertical direction is defined as Y-axis, andthe depth direction is defined as Z-axis. In the editing system 1according to this invention, parameters relating to thethree-dimensional transform can be set to arbitrary values, so that theimage can be transformed arbitrarily.

[0106] The trail effect is the effect that when the image is transferredspatially, the image is frozen as a still image for a predeterminedperiod, and the frozen image is left as an afterimage. Generally, it iscalled recursive effect. In the editing system 1 according to thisinvention, parameters relating to the trail effect can be set toarbitrary values, so that the period for freezing the image and theperiod for leaving the image as an afterimage can be set arbitrarily.

[0107] Also in the special effect processing, as shown in FIG. 8, in theresultant clip FC-009, the first editing point EP1 to the seventhediting point EP7 are set as an edit start point (in-point), an edit endpoint (out-point), and the parameter changing point of the imagetransform.

[0108] The first editing point EP1 indicates the in-point IN4 of thematerial clip MC-004, the start point of the mosaic effect, and thestart point of the crop effect. The second editing point EP2 indicatesthe start point of the three-dimensional transform. The fourth editingpoint EP4 indicates the start point of the trail effect. The seventhediting point EP7 indicates the out-point OUT4 of the material clipMC-004, the end point of the mosaic effect, the end point of the cropeffect, the end point of the three-dimensional transform, and the endpoint of the trail effect. In addition, the third editing point EP3, thefifth editing point EP5, and the sixth editing point EP6 are editingpoints set to change parameters of the three-dimensional transform.These editing points EP3, EP5 and EP6 will be described later.

[0109] In the case of special effect, similar to the compositeprocessing, the material clip MC-004 and the resultant clip FC-009respectively have the internal time lines t4, t9 expressed by theoriginal internal time codes starting from the head position of thevideo data of respective clips. The time codes of the first editingpoint EP1 to the seventh editing point EP7 described above are definedby the time codes on the time line t9 of the resultant clip FC-009.

[0110] The in-point IN4 and the out-point OUT4 of the material clipMC-004 are respectively defined by the time line t4 of the material clipMC-004. Their time codes are “00:10:12:00” and “00:12:18:00”respectively. Accordingly, the time code of the in-point IN4 correspondsto the time code “00:00:00:00” of the first editing point EP1 in theresultant clip FC-009, and the time code of the out-point OUT4corresponds to the time code “00:02:06:00” of the seventh editing pointEP7 in the resultant clip FC-009.

[0111] Further, as shown in FIG. 8, the start point of the mosaic effectspecified as the first special effect E1 is the first editing point EP1that the time code in the resultant clip FC-009 is “00:00:00:00”. Theend point of the mosaic effect is the seventh editing point EP7 that thetime code in the resultant clip FC-009 is “00:02:06:00”.

[0112] Similarly, as shown in FIG. 8, the start point of the crop effectspecified as the second special effect E2 is the first editing point EP1that the time code in the resultant clip FC-009 is “00:00:00:00”. Theend point of the crop effect is the seventh editing point EP7 that thetime code in the resultant clip FC-009 is “00:02:06:00”.

[0113] Also, the start point of the three-dimensional transformspecified as the third special effect E3 is the second editing point EP2that the time code in the resultant clip FC-009 is “00:00:12:03”. Theend point of the three-dimensional transform is the seventh editingpoint EP7 that the time code in the resultant clip FC-009 is“00:02:06:00”.

[0114] Also, the start point of the trail effect specified as the fourthspecial effect E4 is the fourth editing point EP4 that the time code inthe resultant clip FC-009 is “00:01:02:50”. The end point of the traileffect is the seventh editing point EP7 that the time code in theresultant clip FC-009 is “00:02:06:00”.

[0115] Therefore, when the resultant clip FC-009 is reproduced, thevideo image of which the mosaic effect and the crop effect are appliedto the video image of the material clip MC-004 is output during theperiod from the first editing point EP1 to the second editing point EP2.The video image of which the mosaic effect, the crop effect, and thethree-dimensional transform are applied to the video image of thematerial clip MC-004 is output during the period from the second editingpoint EP2 to the fourth editing point EP4. The video image of which themosaic effect, the crop effect, the three-dimensional transform, and thetrail effect are applied to the video image of the material clip MC-004is output during the period from the fourth editing point EP4 to theseventh editing point EP7.

[0116] (3-5) General Idea of the Edit Processing

[0117] In this paragraph, the general idea of the edit processingperformed in the edit module EM will be explained. The resultant clipFC-010 shown in FIG. 4 is a clip produced by editing the resultant clipFC-008 and the resultant clip FC-009. In order to make it easy tounderstand, supposing that the edit processing is performed with thewipe effect, the general idea of the edit processing is explainedreferring to FIG. 9.

[0118] As shown in FIG. 9, in this example, the resultant clip FC-008 isspecified as the first layer L1 and the resultant clip FC-009 isspecified as the second layer L2. The wipe effect is specified as aprocessing of changing from the resultant clip FC-008 specified as thefirst layer L1 to the resultant clip FC-009 specified as the secondlayer L2. Note that in the edit processing, since the video data is notsuperimposed like a composite processing, but the video data arecombined, the temporally earlier video data is specified as the firstlayer L1 and the temporally later video data is specified as the secondlayer L2.

[0119] Further, the wipe effect specified as the change processing is atransition effect for wiping an old picture displayed at present with anew picture to change the picture displayed on a screen. In connection,the wipe effect specified in the example shown in FIG. 9 is the wipeeffect that the picture is changed from the left side of the picture tothe right side when the image of the resultant clip FC-008 is changedinto the image of the resultant clip FC-009.

[0120] Also, in this edit processing, as shown in FIG. 9, in theresultant clip FC-010, the first editing point EP1 to the fifth editingpoint EP5 are set as an edit start point (in-point) of each clip, anedit end point (out-point), and the parameter changing point of theedit.

[0121] The first editing point EP1 indicates the in-point IN8 of theresultant clip FC-008. The second editing point EP2 indicates the startpoint of the wipe effect and the in-point IN9 of the resultant clipFC-009. The fourth editing point EP4 indicates the end point of the wipeeffect and the out-point OUT8 of the resultant clip FC-008. The fifthediting point EP5 indicates the out-point OUT9 of the resultant clipFC-009. Here, the third editing point EP3 is an editing point set forchanging the effect parameters of the wipe effect. The editing point EP3will be described in details later.

[0122] Similarly to the composite processing and the special effectprocessing described above, the resultant clips FC-008, FC-009, andFC-010 have the internal time lines t8, t9, and t10 expressed by theoriginal internal time codes starting from the head position of thevideo data of respective clips. The first editing point EP1 to the fifthediting point EP5 described above are defined by the time codes on thetime line t10 of the resultant clip FC-010.

[0123] The in-point IN8 and the out-point OUT8 of the resultant clipFC-008 are respectively defined by the time line t8 of the resultantclip FC-008, and the time codes are “00:01:01:20” and “00:04:43:00”respectively. Accordingly, the time code of the in-point IN8 correspondsto the time code “00:00:00:00” of the first editing point EP1 in theresultant clip FC-010, and the time code of the out-point OUT8corresponds to the time code “00:03:42:00” of the fourth editing pointEP4 in the resultant clip FC-010.

[0124] Similarly, the in-point IN9 and the out-point OUT9 of theresultant clip FC-009 are respectively defined by the time line t9 ofthe resultant clip FC-009, and their time codes are “00:00:00:50” and“00:02:06:00” respectively. Accordingly, the time code of the in-pointIN9 corresponds to the time code “00:03:39:00” of the second editingpoint EP2 in the resultant clip FC-010, and the time code of theout-point OUT9 corresponds to the time code “00:05:44:10” of the fifthediting point EP5 in the resultant clip FC-010.

[0125] Further, the start point of the wipe effect set to change theimage of the resultant clip FC-008 and the image of the resultant clipFC-009 is set to the second editing point EP2 in the resultant clipFC-010, and set to “00:03:39:00” as a time code. Also, the end point ofthe wipe effect is set to the fourth editing point EP4 in the resultantclip FC-010, and set to “00:03:42:00” as a time code.

[0126] Therefore, when the resultant clip FC-010 is reproduced, thevideo image of the resultant clip FC-008 is output during the periodfrom the first editing point EP1 to the second editing point EP2. Theimage such that the video image of the resultant clip FC-008 issuccessively changed to the video image of the resultant clip FC-009 isoutput by the wipe effect, from the left side of the screen toward theright side, during the period from the second editing point EP2 to thefourth editing point EP4. The image of the resultant clip FC-009 isoutput during the fourth editing point EP4 to the fifth editing pointEP5.

[0127] (4) Graphic Display displayed as GUI

[0128] Next, in this paragraph, the screen of the GUI displayed on thedisplay 2B of the work station 2 when each module is started up will beexplained.

[0129] (4-1) GUI when the Composite Module is Started up

[0130] First, in this paragraph, the GUT when the composite module CM isstarted up is explained. In the editing system 1, the graphic displayshown in FIG. 10 is displayed as a GUI of the composite module CM on thedisplay 2B of the work station 2, when the composite module CM isstarted up.

[0131] As shown in FIG. 10, when roughly divided, the GUI of thecomposite module CM is composed of a menu window 30, a clip tree window31, a key window 32, a library window 33, a time line window 34, aparameter setting window 35, a preview screen display window 36, adevice control window 37, an edit content display window 38, and acontrol command window 39.

[0132] The menu window 30 is an area for displaying the top menuprepared in the editing system 1. In addition, the menu window 30 isdisplayed after the control module CNTM is started up.

[0133] In the editing system 1 according to this invention, for example,a file read menu, an initial setting menu, and a module start-up menu,etc. are prepared as the top menu. When the file read menu is specifiedby pushing down the button of the mouse 2D (hereinafter, thespecification action using the mouse is referred to as click), the listof the resultant clips which have been already registered is displayed.A desired resultant clip is selected by click operation among from thelist to read the edit content of the selected resultant clip onto thetime line window 34 described later. Thus, if the resultant clip alreadyregistered is modified, the file read menu is used to read the resultantclip, and the resultant clip can be modified.

[0134] Further, when the initial setting menu is selected by clickoperation, various setting items are read out. A desired item isselected among from the various items to display a setting screen forthe selected item is displayed. Thus, if a desired item is initiallyset, the setting screen of the item is read out from the initial settingmenu, and the desired Devalue for the item can be set.

[0135] Further, when the module start-up menu is selected by clickoperation, the commands for starting up the composite module CM, thespecial effect module SM, and the edit module EM are displayed. Adesired command is selected among from them to start up the selectedmodule and the GUI corresponding to the module is displayed on thescreen. In fact, the GUI of the composite module CM shown in FIG. 10 isa screen obtained by starting up the composite module CM from the modulestart-up menu.

[0136] The clip tree window 31 is an area for displaying the graphicdisplay to visually obtain the hierarchical relation of clips registeredin the clip database. When the hierarchical relation of clips is thatshown in FIG. 4, the clip tree shown in FIG. 10 is displayed inaccordance with the hierarchical relation. More specifically, in thiscase, since the uppermost clip is the resultant clip FC-010, the clipname of the resultant clip FC-010 “FC-010” is displayed on the uppermostposition of the clip tree window 31. As a result, lower clips beinglinked to the resultant clip FC-010 at a lower position are theresultant clip FC-008 and the resultant clip FC-009. The clip name ofthese lower clips “FC-008” and “FC-009” are displayed below theresultant clip FC-010 being an upper clip and displayed in parallel atthe position shifting toward the right side by one stage. At this time,a line connecting the resultant clip FC-010 and the resultant clipFC-008 and a line connecting the resultant clip FC-010 and the resultantclip FC-009 are displayed, so as to show that the resultant clipsFC-010, FC-008 and FC-009 have the hierarchical relation.

[0137] Further, lower clips being linked to the resultant clip FC-008 ata lower position are the material clip MC-001, the material clip MC-002,and the material clip MC-003. The clip names of the lower clips“MC-001”, “MC-002”, and “MC-003” are displayed below the resultant clipFC-008 being an upper clip and displayed in parallel at the positionshifting toward the right side by more one stage. As this time, a lineconnecting the resultant clip FC-008 and the material clip MC-001, aline connecting the resultant clip FC-008 and the material clip MC-002,and a line connecting the resultant clip FC-008 and the material clipMC-003 are displayed, so as to show that the clips FC-008, MC-001,MC-002, and MC-003 have the hierarchical relation.

[0138] In the similar way, lower clips being linked to the resultantclip FC-009 at a lower position is the material clip MC-004. The clipname of the lower clip “MC-004” is displayed below the resultant clipFC-009 being an upper clip, and displayed at the position shiftingtoward the right side by one stage. As this time, a line connecting theresultant clip FC-009 and the material clip MC-004 is displayed, so asto show that the clips FC-009 and MC-004 have the hierarchical relation.

[0139] In this way, in the clip tree window 31, the clip names of clipsare displayed like a tree, so as to immediately understand the relationbetween clips registered in a database visually.

[0140] In addition, the clip whose clip name is surrounded by a framewith a bold line is a clip being displayed at present to be edited.Moreover, a scroll button 31A of the left and right direction isdisplayed at the bottom position of the clip tree window 31. The scrollbutton 31A is operated by using the mouse 2D, so that the displayed cliptree can be scrolled in the right and left direction.

[0141] Similarly, a scroll button 31B of the up and down direction isdisplayed at the right side position of the clip tree window 31. Thescroll button 31B is operated, so that the displayed clip tree can bescrolled in the up and down direction.

[0142] The key window 32 is an area for displaying key selection buttonsto designate a key processing for the clip to be edited. A desiredbutton is selected among from them to designate the desired keyprocessing for the clip to be edited. At this time, as shown in FIG. 10,the key selection buttons such as a luminance key button, a liner keybutton, a clean key button, a pattern key button, and an external keybutton are prepared.

[0143] In this connection, the key processing is a processing ofhollowing out the area based on the key signal from the video image andputting another image into there. Further, the luminance key is a keyprocessing for performing a hollowing-out processing based on theluminance signal contained in the key signal. The liner key is a kind ofthe luminance key, which is a key processing that the changeable widthof the gain becomes narrower than that of the luminance key. The cleankey is a processing for putting the image to be put into without thehollowing-out in the key processing. Further, the pattern key is a keyprocessing for cutting out based on the wipe pattern. The external keyis a key processing for performing based on the key signal supplied fromthe external device.

[0144] Also in the key window 32, a scroll button 32A of the left andright direction is displayed at the bottom position of the key window32. The scroll button 32A is operated so that the displayed keyselection buttons can be scrolled in the right and left direction.Similarly, a scroll button 32B of the up and down direction is displayedat the right side position of the key window 32. The scroll button 32Bis operated so that the displayed key selection buttons can be scrolledin the up and down direction.

[0145] The library window 33 is an area for displaying the list of thematerial clips or the resultant clips registered in the clip database. Adesired clip is selected among from the clips displayed on the librarywindow 33 to designate the selected clip as the clip to be edited. Thelibrary window 33 will be described in details later.

[0146] The time line window 34 is an area for placing the clips to beedited on the time axis to designate the content of edit. On the timeline window 34 displayed at the composite module CM, the contentsrelating to the composite processing are displayed. The time line window34 is divided into areas. When roughly divided successively from thetop, a time code display area (Time Code), an editing point display area(Edit Point), a preview extent display area (Preview), and a clipspecifying area (L1 to L10).

[0147] The time code display area is an area for displaying the timecode at the editing point. The time code is a time code on the time lineof the resultant clip produced based on the edit contents designated onthe time line window 34.

[0148] The editing point display area is an area for indicating a pointset as an editing point by a triangle mark. For example, when thecomposite processing shown in FIG. 4 and FIG. 7 is specified, theediting points EP1 to EP8 are indicated by using a triangle mark.

[0149] The preview extent display area is an area for indicating theextent of the video data displayed on the preview screen display window36 when a preview button or a view button which is described later isoperated. In this example, the section between the editing point EP1 andthe editing point EP8 are set as the display extent, and a bar showingthe section is displayed.

[0150] The clip specifying area is an area for specifying to each layerthe clip to be edit to which the composite processing is applied. In theediting system 1, ten layers of the layer L1 to the layer L10 areprepared, and the clip being the material of the composite processingcan be specified to each layer. In addition, since the display extent ofthe clip specifying area is limited (as shown in the figure, it is forabout five layers), the layers L1 to L10 can not be displayed alltogether. However, the scroll button 34A displayed at the right side ofthe clip specifying area is operated so that the clip specifying areacan be scrolled in the up and down direction. Therefore, a desired layercan be displayed.

[0151] Among ten layers L1 to L10, the layer L1 is a layer forspecifying the clip being the base (lowermost) image at the time ofcomposite processing. The layers L2 to L10 are layers for specifying theclips which are piled up on the base image. In addition, as the numberof layer becomes larger, the hierarchy of layer becomes higher. Here,the layer L10 is the highest layer.

[0152] Each of the layers L1 to L10 is divided into a video area (Video)for specifying the clip to be composed and a key area (Key) forspecifying the key processing performed on the specified clip. In thiscase, the rectangular graphic image (hereinafter, referred to as cell)indicating the clip is placed on the video area, so as to set the clipto the layer. Similarly, the cell indicating the key processing isplaced on the key area, so as to set the key processing to the clipwhich is specified to the layer.

[0153] Here, as shown in FIG. 10, to set the material clip MC-003 to thelayer L1, the material clip MC-003 is clicked on the clip tree window 31or the material clip MC-003 is clicked on the library window 33, so asto select the material clip MC-003. Such processing is performed todisplay the cell of the material clip MC-003. The cell is transferred tothe video area of the layer L1 and placed at a desired position, so thatthe material clip MC-003 is set to the layer L1.

[0154] Similarly, to set the external key to the layer L1, the externalkey button is clicked on the key window 32, so as to select the externalkey. Such processing is performed to display the cell indicating theexternal key. The cell is placed at the key area of the layer L1, sothat the external key is set to the layer L1. In connection, theoperation of setting the clip or key processing to the layers L2 to L10is same as the operation of setting to the layer L1 described above.

[0155] In addition, the length of the cell indicating the clipcorresponds to the duration (time period from the start to the end ofclip) of the clip. The cell indicating the key processing makes a pairwith the clip placed at the video area, and has the same length as theclip placed at the video area. The characters showing the clip name orkey processing name is displayed on each cell, so as to understand at aglance which clip or key processing is set.

[0156] Also, when the resultant clip placed and displayed at the clipspecifying area is selected by double-clicking, the module which hasproduced the resultant clip (that is, the composite module CM, thespecial effect module SM, or the edit module EM) is started up, and thecontent of edit performed on the resultant clip is displayed on the timeline window of the GUI of the corresponding module.

[0157] The parameter setting window 35 is an area for setting variousparameters relating to edit. On the parameter setting window 35displayed at the time of starting-up the composite module CM, thecontent relating to the composite processing is displayed as a matter ofcourse, and as shown in FIG. 10, the graphic display for setting thegain of the composite processing is displayed.

[0158] In this case, the gain of the composite processing is thecomposite ratio when the video data is piled up. More specifically, whenthe gain is 100%, the upper video data is piled up on the lower videodata so that the lower video data is completely not viewed. For example,when the gain is 50%, the upper video data is piled up on the lowervideo data so that an approximately half of the lower video data isviewed transparently. When the gain is 0%, the upper video data is piledup so that it is not viewed and the lower video data is completelyviewed transparently.

[0159] In addition, the horizontal axis (i.e., time axis) of theparameter setting window 35 corresponds to that of the time line window34 described above, and the change point of the parameters can bedetermined with referring to the contents of the composite processingspecified on the time line window 34. In connection, regarding to thehorizontal direction, that is the left and right direction, the scrollbutton 35A placed at the bottom side of the parameter setting window 35is operated so as to scroll the graphic image of the parameter settingwindow 35 in the direction of left and right. As this time, since thehorizontal axis of the time line window 34 corresponds to that of theparameter setting window 35, the graphic image of the time line window34 and the graphic image of the parameter setting window 35 are linkedand scrolled in the direction of left and right at the same time. Inaddition, regarding to the up and down direction, the scroll button 35Bplaced at the right side of the parameter setting window 35 is operatedso as to scroll the graphic image of the parameter setting window 35 inthe direction of up and down.

[0160] Here, to set the gain of the clip specified to each layer, adesired layer number is first clicked among from the layer numbersdisplayed at the left corner of the parameter setting window 35 tospecify the layer of which parameter is set next. Then, a point of whichparameter is changed is decided and the gain value to be set is decided,with viewing the content of the composite processing specified on thetime line window 34. The position corresponding to the decided point andvalue is clicked at the parameter setting window 35 consisting thevertical axis being the gain value and the horizontal axis being time.Thereby, the gain value and the gain changing point corresponding to theclicked position are registered automatically.

[0161] For example, as shown in FIG. 10, to set the gain of the materialclip MC-003 specified to the layer L1 to 100%, if the positions wherethe gain is 100% are clicked at the positions of the in-point and theout-point of the material clip MC-003, the gain of the material clipMC-003 from the in-point to the out-point are all set to 100%. In theediting system 1, since the set values are interpolated between theparameter setting points so as to be successive values and theinterpolated values are automatically set. If the same values are set attwo parameter setting points in the above way, all values between twopoints are set to the same values.

[0162] Further, regarding the material clip MC-002 set to the layer L2,to set the case where the gain to 59% at the in-point (the editing pointEP2), the gain to 100% at the position a little before the point wherethe material clip MC-003 is piled up (the editing point EP3), and thegain to 0% at the out-point (the editing point EP6), the correspondingpoints may be clicked respectively on the parameter setting window 35.Thus, the set gain values are automatically registered in the clipdatabase. In addition, during the period between the editing point EP2to the editing point EP3 and the period between the editing point EP3 tothe editing point EP6, the gain values are interpolated so as to belinear and successive values based on the values set at respectiveediting points, and the interpolated values are automatically set.

[0163] Similarly, regarding the material clip MC-003 set to the layerL3, to set the case where the gain to 100% at the in-point (the editingpoint EP4), the gain to 67% at the approximately center position of thematerial (the editing point EP5), and the gain to 51% at the out-point(the editing point EP7), the corresponding points may be clickedrespectively on the parameter setting window 35. Thus, the set gainvalues are automatically registered in the clip database., In addition,also in this case, during the period between the editing point EP4 tothe editing point EP5 and the period between the editing point EP5 tothe editing point EP7, the gain values are interpolated so as to belinear and successive values based on the values set at respectiveediting points, and the interpolated values are automatically set.

[0164] In this way, if the gain values are set as described above, thegain values are successively changed at respective timings. Therefore,the picture of such image can be obtained that after the video data ofthe material clip MC-002 is gradually viewed on the video data of thematerial clip MC-003, the video data of the material clip MC-001 isfurther viewed on these video data, thereafter, the video data of thematerial clip MC-002 and the material clip MC-001 gradually becomefaint.

[0165] In addition, in the parameter setting window 35, as shown in FIG.10, the values of the set parameters are displayed correspondingly tothe editing points as a graph having the horizontal axis being time andthe vertical axis being gain values. Thereby, an operator looks thedisplay and can visually understand at a glance the parameter, thelayer, and the timing which have been set.

[0166] The preview window 36 is an area for displaying the video data ofthe material clip or the resultant clip, when the preview button, theview button, the all preview button, or the all view button describedlater is operated. The provision of this display area makes it possibleto confirm the video image of the material clip or the resultant clipproduced as a result of edit, while edit works is being performed.

[0167] The device control window 37 is an area for displaying thecommand buttons for controlling the operation of the video disk recorder5 in which the video data of clips are stored. As shown in FIG. 10, areproduction button 37A, a stop button 37B, and six skip buttons 37C to37H are provided as command buttons. In this case, the reproductionbutton 37A is a command button for sending the reproduction command tothe video disk recorder 5. The stop button is a command button forsending the reproduction stop command to the video disk recorder 5. Theskip buttons 37C, 37D are command buttons for sending to the video diskrecorder 5 the skip command for skipping the reproduction position toone frame forward or one frame backward. The skip buttons 37E, 37F arecommand buttons for sending to the video disk recorder 5 the skipcommand for skipping the reproduction position to one editing pointforward or one editing point backward. The skip buttons 37G, 37H arecommand buttons for sending to the video disk recorder 5 the skipcommand for skipping the reproduction position to the head position orthe end position of the video data. The provision of these commandbuttons makes it possible to easily control the operation of the videodisk recorder 5 while edit works is being performed.

[0168] The edit content display window 38 is called co-time line, and anarea for displaying the content of edit specified on the time linewindow 34. In the time line window 34, since all contents of edit cannot be displayed all together because of the restriction of the screen,the graphic image that the content of edit is reduced is displayed onthe edit content display window 38, so as to easily understand whichcontent of edit is specified as a whole. For example, in the case wherethe content of edit such like that three material clips MC-003, MC-002and MC-001 described above are composed is specified on the time linewindow 34, the graphic image such that three bar graphic images showingthe clips specified to respective layers are superimposed is displayedon the edit content display window 38. Therefore, an operator looks thedisplay, and can entirely understand the contents of the edit specified,which is the composite processing of three clips.

[0169] In addition, in the edit content display window 38, also in thecase where the resultant clip, which is displayed on the library window33 and the clip tree window 31 and which has been already registered inthe clip database, is selected, the graphic image showing the editcontent of the resultant clip is displayed. Therefore, also in the casewhere the resultant clip displayed on the library window 33 and the cliptree window 31 is selected during the edition on the time line window34, the contents of edit specified to the selected resultant clip can beeasily obtained.

[0170] Finally, the control command window 39 is an area for displayingthe list of the control commands used in the editing system 1. As shownin FIG. 10, for example, the control commands to be displayed have aneditor button (Editor), a composite button (Composite), a special effectbutton (S-Effect), a preview button (Preview), a view button (View), anall preview button (All Preview), and an all view button (All View),etc.

[0171] The editor button, the composite button, and the special effectbutton are buttons for starting up the respective modules for edit. Morespecifically, the editor button is a button for starting up the editmodule EM. The editor button is clicked to start up the edit module EMeven if the composite module CM has been driven for instance. Further,the composite button is a button for starting up the composite moduleCM. The composite button is clicked to start up the composite module CMeven if the special effect module SM has been driven for instance.Further, the special effect button is a button for starting up thespecial effect module SM. The special effect button is clicked to startup the special effect module SM even if the edit module EM has beendriven for instance.

[0172] On the other hand, the preview button, the view button, the allpreview button, and the all view button are buttons for confirming thecontent of the material clip or the resultant clip. More specifically,the preview button is a button used for displaying the video data of theselected clip on the preview picture display window 36. When the previewbutton is operated, since the edit content specified is not executed,the displayed video data may be different from the final result (thevideo data of the final result is displayed when the edit content hasbeen already executed and the video data corresponding to the editcontent has been produced.). However, when the preview button isoperated, the display is immediately started, and it is used in the caseof checking the length of clip in the edit process.

[0173] The view button is a button used for displaying the video data ofthe selected clip on the preview picture display window 36. The viewbutton is different from the preview button, and the specified editcontent is executed. Thus, when the view button is operated, although ittakes time to display, the video data after edit can be confirmed.

[0174] The all preview button is a button used for displaying the videodata from the first clip to be edited to the last clip to be edited onthe preview picture display window 36 without selection of clip. Also inthe all preview button, the specified edit content is not executed sameas that of the preview button.

[0175] The all view button is a button used for executing the editcontent specified to all clips to be edited and for displaying the videodata on the preview picture display window 36. The all view button isoperated so that the specified edit content is executed and the videodata of the last result can be confirmed. When the edit content isexecuted, the produced clip vide data is automatically stored in thevideo disk recorder 5 and registered in the clip database CDB.

[0176] (4-2) GUI when the Special Effect Module is Started up

[0177] Next, in this paragraph, the GUI when the special effect moduleSM is started up will be explained. In the editing system 1, when thespecial effect module SM is started up, the graphic display shown inFIG. 11 is displayed as a GUI of the special effect module SM on thedisplay 2B of the work station 2.

[0178] As shown in FIG. 11, when roughly divided, the GUI of the specialeffect module SM is composed of a menu window 30, a clip tree window 31,an effect selection window 40, a library window 33, a time line window41, a parameter setting window 42, a preview screen display window 36, adevice control window 37, an edit content display window 38, and acontrol command window 39.

[0179] Note that among the windows displayed on the GUI of the specialeffect module, the menu window 30, the clip tree window 31, the librarywindow 33, the preview screen display window 36, the device controlwindow 37, the edit content display window 38 and the control commandwindow 39 are same as that of the composite module CM described above,so that the explanation will be omitted here.

[0180] First, the effect selection window 40 is an area for selectingthe special effect performed on the video data of clip, and the commandbuttons of various special effects are displayed thereon. The commandbuttons to be displayed are a three-dimensional button for specifyingthe three-dimensional transform, a trail button for specifying the trailprocessing which adds an afterimage, a brick button for specifying thebrick processing which puts the video image on the plane of a cube androtates it, a shadow button for specifying the shadow processing whichadds a shadow to the video data, a mix button for specifying the mixprocessing which mixes the video data, a light button for specifying thelight processing which lights up an object from one direction to add theshadow, a crop button for specifying the crop processing which cuts outa predetermined area from the video data, and so on.

[0181] In the effect selection window 40, to select a desired specialeffect, the editing point on which the special effect is performed isdesignated on the time line window 41, and then the command buttoncorresponding to the desired special effect is clicked so as toautomatically specify the special effect.

[0182] The time line window 41 is an area for placing the clip to beedited on the time axis to designate the content of edit, On the timeline window 41 displayed in the special effect module SM, the contentsrelating to the special effect processing are displayed. The time linewindow 41 is divided into areas. When roughly divided successively fromthe top, the areas are a time code display area (Time Code), an editingpoint display area (Edit Point), a preview extent display area(Preview), and a clip and special effect specifying area (L1 to L10).

[0183] The time code display area is an area for displaying the timecode at the editing point. The time code is a time code on the time lineof the resultant clip produced based on the edit content designated onthe time line window 41.

[0184] The editing point display area is an area for indicating a pointset as an editing point by a triangle mark. For example, when thespecial effect processing shown in FIG. 4 and FIG. 8 is specified, theediting points EP1 to EP7 are indicated by using triangle marks.

[0185] The preview extent display area is an area for indicating theextent of the video data displayed on the preview screen display window36 when a preview button and a view button which are described above areoperated. In this example, the section between the editing point EP1 andthe editing point EP7 (that is, the whole resultant clip FC-009) are setas the display extent, and a bar showing the section is displayed.

[0186] The clip and special effect specifying area is an area forspecifying for each layer the special effect applied to the clip. In theediting system 1, ten layers of the layer L1 to the layer L10 areprepared, so that the clips to be special-effect processed can bespecified to respective layers. Note that the display extent of the clipand special effect specifying area is limited (as shown in the figure,it is for about two layers), and the layers L1 to L10 can not bedisplayed all together. However, the scroll button 41A displayed at theright side of the clip and special effect specifying area is operated sothat the clip and special effect specifying area can be scrolled in theup and down direction. Therefore, a desired layer can be displayed.

[0187] Each of the layers L1 to L10 is divided into areas which consistsfour special effect areas (E1 to E4), a video area (Video) forspecifying the clip to which the special effect is applied and a keyarea (Key) for specifying the key processing performed on the specifiedclip. The special effect specifying area is an area for designating thespecial effect applied to the clip registered in the video area. Fourspecial effect specifying areas are provided for one layer, so that fourspecial effects can be applied to one clip at the same time. Forexample, as shown in FIG. 11, if the mosaic processing is specified asthe special effect E1, the crop processing is specified as the specialeffect E2, the three-dimensional transform is specified as the specialeffect E3, and the trail processing is specified as the special effectE4, four special effects can be applied to the clip MC-004 specified inthe video area.

[0188] To set the special effect in the special effect specifying area,the editing points are previously designated to specify the extent towhich the special effect is applied, and a desired command button isclicked on the effect selection window 40. Then, the cell indicating theselected special effect is displayed. The cell is placed on the specialeffect specifying area, so as to set the special effect automatically.

[0189] To set the clip in the video area, the clip displayed on thelibrary window 33 is clicked first or the clip displayed on the cliptree window 31 is clicked, so as to select the clip to be edited. Suchprocessing is performed to display the cell of the selected clip. Thecell is placed at a desired position of the video area, so that the clipis set to the video area.

[0190] Further, to set the key processing in the key area, when theportion of “Key” of the key area is clicked, the effect selection window40 is changed into the key window 32 described above. A desired keybutton is clicked to select the key processing. Such processing isperformed to display the cell indicating the selected key processing.The cell is placed at the key area, so that the key processing isautomatically set.

[0191] In addition, when the resultant clip already placed and displayedat the video area is selected by double-clicking, the module of whichthe resultant clip is produced (that is, the composite module CM, thespecial effect module SM, or the edit module EM) is started up, and thecontent of edit applied to the resultant clip is displayed on the timeline window of the GUI of the corresponding module.

[0192] The parameter setting window 42 is an area for setting parametersof special effect processing specified by an operator. In the parametersetting window 42, if the command button of the effect selection window40 is clicked, a parameter setting screen relating to the clickedspecial effect is displayed. For example, if the 3D button is clicked onthe effect selection window 40 to specify the three-dimensionaltransform, the parameter setting screen relating to thethree-dimensional transform shown in FIG. 11 is displayed on theparameter setting window 42.

[0193] As shown in FIG. 11, the parameters in the three-dimensionaltransform are the position in the three-dimensional space (X, Y, Z), therotating direction in the three-dimensional space (X, Y, Z), the aspectratio (Asp) indicating the ratio of length and breadth of image, theskew (Skew) which is parameter of the distortion, and the perspectivevalue (Pers) representing the value of far and near. These values ofparameters can be set to arbitrary values between the maximum settingextent MAX and the minimum setting extent MIN using a default value(=“0”) as a standard value.

[0194] The horizontal axis (i.e., time axis) of the parameter settingwindow 42 corresponds to that of the time line window 41 each other, andthe change point of the parameters can be determined with referring tothe content of the special effect processing specified at the time linewindow 41. In connection, regarding to the horizontal direction, that isthe left and right direction, the scroll button 42A placed at the bottomside of the parameter setting window 42 is operated so as to scroll thegraphic image on the parameter setting window 42 in the direction ofleft and right. At this time, since the horizontal axis of the time linewindow 41 corresponds to that of the parameter setting window 42 eachother, the graphic image of the time line window 41 and the graphicimage of the parameter setting window 42 are linked and scrolled in thedirection of left and right at the same time. In addition, regarding tothe up and down direction, the scroll button 42B placed at the rightside of the parameter setting window 42 is operated so as to scroll thegraphic image on the parameter setting window 42 in the direction of upand down.

[0195] Here, to actually set the parameters of the three-dimensionaltransform, a desired item is first clicked among from the items ofparameters displayed at the left corner of the parameter setting window42 to specify the item that parameter is set next. Then, a point ofwhich parameter is changed is decided and the setting value is decidedwith viewing the content specified on the time line window 41. Theposition corresponding to the decided point and the setting value isclicked on the parameter setting window 42 consisting the vertical axisbeing the parameter value and the horizontal axis being time. Thereby,the parameter value and the parameter changing point corresponding tothe clicked position are registered automatically in the clip databaseCDB.

[0196] For example, as shown in FIG. 11, in the case where the positionin the X-axis direction is gradually moved from the editing point EP4 tothe minus direction, the desired values are successively clicked so asto register the values automatically. Similarly, in the case where theposition in the Y-axis direction is gradually moved from the editingpoint EP6 to the plus direction, the desired values are successivelyclicked so as to register the values automatically. Similarly, in thecase where the position in the Z-axis direction is gradually moved fromthe editing point EP2 to the plus direction, the desired values aresuccessively clicked so as to register the values automatically. Inaddition, the sections between the points specified by an operator areinterpolated successively and the values such that the video image iscontinuously moved are automatically set.

[0197] Further, in the case of performing the rotation processing suchthat the video image is slowly rotated in the minus direction with theX-axis being centered in the range from the editing point EP2 to theediting point EP5, and the slowly rotated in the opposite directionafter the editing point EP5 by turn, desired values are clicked at theediting point EP5 and the editing point EP7 so as to register the valuesautomatically. In addition, also in this case, the section between thepoints specified by an operator are interpolated successively and thevalues such that the video image is continuously rotated areautomatically set. In connection, it can be arbitrarily decided bysetting that the section is interpolated linearly or interpolated with aspline curve. In this example, the rotation processing is set to beinterpolated with a spline curve, so that the values are set inaccordance with a spline curve between the points specified by theoperator.

[0198] In this way, if desired values are set to the parameters of thespecial effect on the parameter setting window 42, the values ofparameters are registered in the clip database CDB, and the specialeffect is applied to the video data of the clip to be edited based onthe registered parameter values. In addition, in the parameter settingwindow 35, as shown in FIG. 11, the values of the set parameters aredisplayed corresponding to the editing points on a graph having thehorizontal axis being time and the vertical axis being parameter values.Thereby, an operator looks the display and can visually understand at aglance the values, the parameters, and the timings which have been set.

[0199] (4-3) GUI when the Edit Module is Started up

[0200] Next, in this paragraph, the GUI when the edit module EM isstarted up is explained. In the editing system 1, the graphic displayshown in FIG. 12 is displayed as a GUI of the edit module EM on thedisplay 2B of the work station 2, when the edit module EM is started up.

[0201] As shown in FIG. 12, when roughly divided, the GUI of the editmodule EM is composed of a menu window 30, a clip tree window 31, aneffect selection window 50, a library window 33, a time line window 51,a parameter setting window 52, a preview screen display window 36, adevice control window 37, an edit content display window 38, and acontrol command window 39.

[0202] Note that among the windows displayed on the GUI of the editmodule EM, the menu window 30, the clip tree window 31, the previewscreen display window 36, the device control window 37, and the controlcommand window 39 are same as that of the composite module CM describedabove, so that the explanation is omitted here.

[0203] First, the effect selection window 50 is an area for selectingthe transition effect used in changing the video data of clip specifiedas an object to be edited, and the command buttons of various transitioneffects are displayed thereon. The command buttons to be displayed are awipe button for specifying the wipe effect which changes an image bywiping the image being displayed at present with a new image, a slidebutton for specifying the slide effect which changes into a new image bysliding an old image like the Kamishibai (telling a story with picturecards), a split button for specifying the split effect which changesinto a new image by splitting an old image to be slid, a squeeze buttonfor specifying the squeeze Reprocessing which changes an image byspreading a new image on an old image, and a page turn button forspecifying the page turn processing which changes an image by paging anold image, and so on.

[0204] In the effect selection window 50, a scroll button 50A of theleft and right direction is displayed at the bottom position of thearea, so as to scroll the displayed command button in the right and leftdirection. Similarly, a scroll button 50B of the up and down directionis displayed at the right side position of the effect selection window50, so as to scroll the displayed command button in the up and downdirection.

[0205] In the effect selection window 50, to select a desired transitioneffect, the editing point on which the transition effect is performed isdesignated on the time line window 51, and then the command buttoncorresponding to the desired transition effect is clicked so as toautomatically specify the transition effect.

[0206] The library window 33 is an area for displaying the list of thematerial clips or the resultant clips registered in the clip databaseCDB. On the library window 33, as shown in FIG. 10 and FIG. 11, althoughonly a title bar is displayed usually, the title bar is clicked to opena window, so that the library window 33 is entirely displayed as shownin FIG. 12.

[0207] As shown in FIG. 12, on the library window 33, clips aredisplayed with a card graphic display 33A. At this time, the cardgraphic display 33A is composed of a still picture display part 33B, anattribute display part 33C, and a clip name display part 33D. The stillpicture of the in-point or the out-point of the clip is displayed on thestill picture display part 33B. Thereby, an operator can understandeasily that which of video data is the clip produced from by viewing thescreen displayed on the still picture display part 33B.

[0208] The character of “FC” or “MC” showing the attribute of the clipis displayed on the attribute display part 33C. In this case, “FC” showsthat the clip is the resultant clip produced as a result of the edit,and “MC” shows that the clip is the material clip only taken out fromthe source video data. In this way, the information showing theattribute is displayed so that the operator can easily understandwhether the clip is the resultant clip or the material clip by viewingthe display. The clip name added by the operator is displayed on theclip name display part 33D. Note that the clip name has been registeredin the blip database CDB as a clip management data described later.

[0209] Thus, in the library window 33, the clip which has beenregistered already in the clip database CDB is displayed as a list, sothat the clip to be edited is easily selected among from the clipsalready registered.

[0210] In addition, a scroll button 33E is displayed at the right sideposition of the library window 33. The scroll button 33E is operated toscroll the library window 33 in the up and down direction, so that theall clips registered in the library window 33 can be displayed.Therefore, the clip which is not shown at present can be also selected.

[0211] The time line window 51 is an area for placing the clips to beedited on the time axis to designate the content of edit. On the timeline window 51 displayed at the edit module EM, the content relating tothe edit processing is displayed. The time line window 51 is dividedinto areas. When roughly divided successively from the top, the areasare a time code display area (Time Code), an editing point display area(Edit Point), a preview extent display area (Preview), a video andeffect specifying area (V), and an audio specifying area (A).

[0212] The time code display area is an area for displaying the timecode at the editing point. The time code is a time code on the time lineof the resultant clip produced based on the edit content designated onthe time line window 51.

[0213] The editing point display area is an area for indicating pointsset as an editing point by triangle marks. For example, when the editprocessing shown in FIG. 4 and FIG. 9 is specified, the editing pointsEP1 to EP5 are indicated by using triangle marks. However, in FIG. 12,since the area and the vicinity on which the transition effect isapplied are only displayed on the time line window 51, the editingpoints EP2 to EP4 are only displayed. In addition, to display theediting point EP1 and the editing point EP5, as described later, thescroll button of the left and right direction is operated on theparameter setting window 52, so that the graphic image in the time linesetting window 52 is scrolled in the left and right direction to displaythe editing point EP1 or the editing point EP5.

[0214] The preview extent display area is an area for indicating theextent of the video data displayed on the preview screen display window36 when a preview button and a view button which are described above areoperated. In this example, since the extent from the section between theediting point EP1 and the editing point EP2 to the section between theediting point EP4 and the editing point EP5 are set as the displayextent, a bar showing the extent is displayed.

[0215] The video and effect specifying area is divided into areas. Theyare a first and second video area (Video-L1, Video-L2) for specifyingthe clip to be edit, and an effect area (Effect) for specifying thetransition applied to the clip to be edited.

[0216] To specify the clip to be edited in the first or second videoarea, a desired clip is clicked on the library window 33 or the cliptree window 31 to display the cell showing the clip. The cell is placedin the first or second video area, so that the clip is set to the firstor second video area and registered as a clip to be edited. For example,if the resultant clip FC-008 is clicked and placed at the first videoarea, and the resultant clip FC-009 is clicked and placed at the secondvideo area, as shown in FIG. 12, the resultant clips FC-008 and FC-009are set to the first and second video area respectively. In addition,the video data set to the first video area becomes an old video data,and the video data set the second area becomes the video data newlychanged.

[0217] Similarly, to specify the transition effect in the effect area, adesired effect button is clicked on the effect selection window 50 todisplay the cell showing the effect. The cell is placed in the effectarea, so that the effect is set to the effect applied to the clip to beedited. For example, if the wipe button is clicked on the effectselection window 50, the cell showing the wipe is displayed. The cell isplaced at the effect area, as shown in FIG. 12, the wipe processing isset as a processing of changing the resultant clip FC-008 and theresultant clip FC-009.

[0218] The audio specifying area is an area for specifying the audiodata output with the video data. In this case, it is divided into thefirst and second audio areas (Audio-1ch, Audio-2ch). In addition, to setthe audio data in the first and second audio areas, similarly to thesetting method in the video area, a desired clip is clicked and placedin the first or second audio area, the audio data of the clip is set tothe audio data to be output. In connection, the audio data set in thefirst audio area is output to the first channel of the stereobroadcasting, and the audio data set in the second audio area is outputto the second channel of the stereo broadcasting.

[0219] In addition, the resultant clip which has been placed in thefirst or second video area and already displayed is selected bydouble-clicking, the module which has produced the clip, that is thecomposite module CM, the special effect module SM, or the edit module EMis started up and the content of the edit which has been applied to theclip is displayed on the time line window of the GUI of thecorresponding module.

[0220] The parameter setting window 52 is an area for setting parametersrelating to the transition effect specified by the operator. In theparameter setting window 52, when the effect button of the effectselection window 50 is clicked, the parameter setting screen relating tothe clicked effect is displayed. For example, if the wipe button isclicked on the effect selection window 50 to specify the wipeprocessing, as shown in FIG. 12, the parameter setting screen relatingto the wipe processing is displayed on the parameter setting window 52.

[0221] Parameters in the wipe processing, as shown in FIG. 12, are theaspect ratio (Aspect) indicating the ratio of length and breadth of wipepattern, the angle (Angle) prescribing the angle of wipe pattern, thespeed (Speed) prescribing the speed of wipe pattern in changing theimage, the horizontal modulation (H Mod) prescribing the wave given inthe horizontal direction of the wipe pattern edge, and the verticalmodulation (H Mod) prescribing the wave given in the vertical directionof the wipe pattern edge. These parameter values can be set to arbitraryvalues between the maximum setting extent MAX to the minimum settingextent MIN based on the default value (=“0”). However, as the parameterof the speed, the default value is set to the minimum setting extentMIN, and the changeable extent are from the default value to the maximumsetting value MAX.

[0222] The horizontal axis (that is, time axis) of the parameter settingwindow 52 corresponds to that of the time line window 51 each other, andthe change point of the parameter can be decided, with viewing thecontent of the edit processing specified on the time line window 51. Inconnection, with regard to the vertical direction, that is the left andright direction, the scroll button 52A positioned at the bottom of theparameter setting window 52 is operated so as to scroll the graphicimage in the parameter setting window 52 in the direction of left andright. At this time, the horizontal axis of the time line window 51corresponds to that of the parameter setting window 52 each other, thegraphic image of the time line window 51 and the graphic image of theparameter setting window 52 are linked and scrolled in the left andright direction at the same time. In addition, with regard to the up anddown direction, the scroll button 52B positioned at the right side ofthe parameter setting window 52 is operated so as to scroll the graphicimage in the parameter setting window 52 in the direction of up anddown.

[0223] Here, to actually set the parameters of the wipe processing, adesired item is first clicked among from the items of parameterdisplayed at the left corner of the parameter setting window 52 tospecify the item of which parameter is set next. Then, a point of wherethe parameter is changed is decided with viewing the content specifiedat the time line window 51, and the setting value is decided. Theposition corresponding to the decided point and the setting value isclicked on the parameter setting window 52 consisting the vertical axisbeing parameter values and the horizontal axis being time. Thereby, theparameter value and the parameter changing point corresponding to theclicked position are registered automatically in the clip database CDB.

[0224] For example, as shown in FIG. 12, in the case where the aspectratio of the wipe pattern is gradually increased from the editing pointEP2 to the editing point EP4, the desired values are successivelyclicked so as to register the values automatically. In addition, thesection between the points specified by an operator are interpolatedsuccessively and the values such that the aspect ratio of the wipepattern is continuously changed are automatically registered.

[0225] Similarly, it is desired that the angle of the wipe pattern isgradually increased from the editing point EP2 to the editing point EP3,and the wipe pattern is gradually inclined from the editing point EP3 tothe editing point EP4, the desired values are successively clicked so asto register the values automatically. Also in this case, the sectionbetween points specified by the operator is interpolated, and the valuessuch that the wipe pattern changes continuously is registeredautomatically. In connection, it can be arbitrarily decided whether thesection is interpolated linearly or interpolated with a spline curve. Inthis example, the angle is set to be interpolated with a spline curve,so that the section specified by the operator is set to the value whichis along the spline curve.

[0226] Further, it is desired that the speed of the wipe pattern isfixed from the editing point EP2 to the editing point EP3, and graduallyaccelerated from the editing point EP3 to the editing point EP4, desiredvalues are successively clicked so as to register the valuesautomatically. In addition, also in this case, the section betweenpoints specified by an operator is interpolated, and the value such thatthe speed of the wipe pattern is continuously changed is registeredautomatically.

[0227] Thus, in the parameter setting window 52, when a desired value isset to the parameter of the transition effect, the value of parameter isregistered in the clip database CDM, and the transition effect isapplied to the video data of the clip to be edited based on theregistered value of parameter. In addition, in the parameter settingwindow 52, as shown in FIG. 12, the set value of parameters aredisplayed corresponding to the editing points on a graph having thehorizontal axis being time and the vertical axis being parameter values.Thereby, an operator looks the display and can visually understand at aglance the parameters, the values, and the timings which have been set.

[0228] The edit content display window 38 is an area for displaying withthe graphic image the content of edit specified on the time line window51. As described above in the time line window 51, in the case ofspecifying the edit processing such that two clips FC-008, FC-009 areswitched by the wipe processing, the graphic image such that the graphicimage showing the wipe processing is sandwiched between bar graphicimages showing the respective clips unevenly is displayed. Thereby, anoperator looks this display so as to easily understand which editcontent is indicated as a whole. Specially, as shown in FIG. 12, whenonly a part of area is displayed on the time line window 51, althoughthe content of entire processing is not easy to understand, looking atthe edit content display window 38, the content of entire processing canbe easily understood.

[0229] (5) Method for Managing the Clip Management Data in the ClipDatabase

[0230] In the editing system 1 according to this invention, the materialclips and resultant clips produced by editing the material clips are allregistered in the clip database CDB. The data registered in the clipdatabase CDB, when roughly divided, are the clip video data of thematerial clip and the resultant clip, and the clip management data formanaging the clip video data. In this paragraph, the method for managingthe clip management data is explained.

[0231]FIG. 13 shows a database for the clip management data generated inthe clip data base CDB (mainly, RAM 21B), when the edit processing shownin FIGS. 7, 8, and 9 are instructed. The database for managing the clipmanagement data, as shown in FIG. 13, is composed of clip ID code, clipname, attribute, pointer to image data, duration, parent link ID code,child link ID code, enable/disable flag, and work data, when roughlydivided.

[0232] The clip ID code is an identification number of the serial numberautomatically added to the clip in the order of being registered as aclip. Therefore, the registered clip can be identified on the basis ofthe clip ID code.

[0233] The attribute of clip is data for identifying whether the clip isonly a material clip or the clip is a resultant clip produced by editinga material clip. If it is a material clip, the code “M” is registered asthe attribute of the clip. If it is a resultant clip, the code “F” isregistered.

[0234] The clip name is a name for identifying the clip, which is addedto the clip. In this example, when the clip ID code is “001” and theattribute of the clip is “M”, the name “MC-001” is automatically addedas a clip name. In addition, an arbitrary name can be added as a clipname adapting the user's taste. In connection, the clip name displayedat the clip name display part 33D of the library window 33 is this clipname.

[0235] The pointer to the image data is composed of eight-byte data, andis a pointer showing the head address of the clip video data recorded inthe video disk recorder 5. In the editing system 1, the clip video datahas been stored in the video disk recorder 5 having a plurality of harddisk, and the pointer to the image data indicates the logical address ofthe hard disk array.

[0236] The duration is a time code showing the reproduction period ofthe clip video data of the clip. That is, it is a time code showing thetime from the start to the end of the clip video data.

[0237] The parent link ID code is the clip ID code of the clip which islinked thereto as an upper clip. For example, since the material clipMC-001 of which the clip ID code is “001” is linked to the resultantclip FC-008 of which the clip ID code is “008”, the clip ID code “008”of the resultant clip FC-008 has been registered as a parent link IDcode.

[0238] In addition, for the clip which does not have the upper clipbecause it is the uppermost clip, “000” is registered as a parent linkID code. For example, the resultant clip FC-010 does not have the upperclip, thereby “000” has been registered as a parent link ID code. Inthis way, if the parent link ID code is “000”, it can be easilyunderstand that it is the uppermost clip.

[0239] The child link ID code is the clip ID code of the clip which islinked thereto as a lower clip. For example, the material clips MC-001,MVC-002, and MC-003 are linked as a lower clip to the resultant clipFC-008 of which the clip ID code is “008”. At this time, the materialclip MC-001 is specified as the third layer L3, the material clip MC-002is specified as the second layer L2, and the material clip MC-003 isspecified as the first layer L1. Therefore, “003” has been registered asthe clip ID code of the clip which is the lower clip of the resultantclip FC-008 and is specified to the first layer L1, “002” has beenregistered as the clip ID code of the clip which is the lower clip ofthe resultant clip FC-008 and is specified to the second layer L2, and“001” has been registered as the clip ID code of the clip which is thelower clip of the resultant clip FC-008 and is specified to the thirdlayer L3. In addition, the lower clip being linked to the lowerhierarchy is managed corresponding to the layer, so as to easilyunderstand that which of lower clips is specified to which of layers.

[0240] In addition, in the clip having no lower clip, no data isregistered as a child link ID code. For example, the material clipMC-001 is only a material clip and has no lower clip, thereby the childlink ID code is a blank.

[0241] The enable/disable flag is a flag showing whether the clip isenable or disable. When the clip is enable, the code “E” is registered,and when the clip is disable, the code “D” is registered. In connection,if the content of edit specified has been executed and the clip videodata has been produced as a result of edit, the enable flag isregistered. If the content of edit has not been executed and the clipvideo data has not been produced, or if although the content of edit hasbeen once executed, thereafter the content of edit and the clip beingmaterial is changed so that the clip video data does not correspond tothe actual edit content, the disable flag is registered. In addition,the enable/disable flag is provided as a clip management data, so thatwhen the database for clip management data is referred, it can be easilyunderstood whether the clip is enable or disable.

[0242] The work data is data showing the edit content specified to theclip. Therefore, some work data has been registered in the resultantclips FC-008, FC-009, and FC-010 produced by edit. However, no work datahas been registered in the material clip MC-001 to the material clipMC-007 which has not been produced by edit.

[0243] As shown in FIG. 13, when roughly divided, the work data isclassified to a module ID code, an editing point data, and an imageprocessing data. The module ID code is an identification numberindicating the module used in the edit work for producing the resultantclip. In this case, the code “C” is registered when the composite moduleCM is used, the code “S” is registered when the special effect module SMis used, and the code “E” is registered when the edit module EM is used.

[0244] Also, the editing point data is data composed of all editingpoints specified to the resultant clip and time codes corresponding tothe editing points.

[0245] Further, the image processing data is composed of the compositedata, the special effect data, and the edit data. The composite data isdata being parameter values specified in the composite processing, thespecial effect data is data being parameter values specified in thespecial effect processing, and the edit data is data being parametervalues specified in the edit processing.

[0246] In addition, when the content of edit processing is modified, thecontents of these clip management data are rewritten at any time basedon the new edit content. However, the old clip management data is noteliminated, and another clip ID code and the clip name are added to bestored as a backup data. For example, when the content of the specialeffect processing for the resultant clip FC-009 is modified, as shown inFIG. 14, the clip management data before modification is stored as abackup data.

[0247] More specifically, when the new special effect processing isinstructed to the resultant clip FC-009, the editing point data aftermodification and the special effect data after modification are producedbased on the content of the new special effect processing, and they areregistered as a work data in the place of the clip before modification(i.e., the place that the clip ID data is “009”) respectively. On theother hand, to the editing point data before modification and thespecial effect data before modification which have been registered as awork data before the new special effect processing is instructed, thenew clip ID code “009BK1” and the clip name “FC-009BK1” are assigned.Then, on the basis of these identification information, they areregistered in the other area of the database as a clip management datafor backup. However, in the clip management data registered as backup,the enable/disable flag is changed into the code “D” indicating thedisable.

[0248] In this way, the clip management data before modification isremained as a backup, so that even if you do not like the resultant clipFC-009 after modification, you can easily return to the resultant clipFC-009BK1 before modification based on the clip management data beforemodification which is remained as a backup.

[0249] Here, the editing point data, composite data, special effectdata, and edit data which are registered as work data described aboveare concretely explained hereinafter. First, referring to FIGS. 15 to17, the editing point data is explained.

[0250] When the composite processing shown in FIG. 7 is instructed tothe resultant clip FC-008, the editing point shown in FIG. 15 isregistered. As shown in FIG. 15, the editing point data is data forspecifying that which part of the lower clips is used to the clip videodata of the upper clip, and is composed of the time code of in-pointindicating the starting position of the lower clip and the time code ofout-point indicating the end position.

[0251] As shown in FIG. 7, the time code of the in-point of the materialclip MC-003 specified as the first layer L1 is “00:00:31:02” on the timeline t3, and the position of the in-point corresponds to the time code“00:00:00:00” on the time line t8 of the resultant clip FC-008.Therefore, in the editing point data, as shown in FIG. 15, the time code“00:00:00:00” of the resultant clip FC-008 and the time code“00:00:31:02” of the in-point of the material clip MC-003 arecorrespondingly Registered at the editing point EP1. Further, as shownin FIG. 7, the time code of the out-point of the material clip MC-003specified as the first layer L1 is “00:05:18:02” on the time line t3,and the position of the out-point corresponds to the time code“00:04:47:00” on the time line t8 of the resultant clip FC-008.Therefore, in the editing point data, as shown in FIG. 15, the time code“00:04:47:00” of the resultant clip FC-008 and the time code“00:05:18:02” of the out-point of the material clip MC-003 arecorrespondingly registered at the editing point EP8. The editing pointof the material clip MC-003 specified as the first layer L1 is decidedby the time codes of the in-point and the out-point.

[0252] Similarly, as shown in FIG. 15, the time codes “00:00:51:00” and“00:03:04:20” of the in-point and out-point of the material clip FC-002specified as the second layer L2 are also registered correspondingly tothe time codes of the resultant clip FC-008. Also, the time codes“00:01:40:03” and “00:02:45:48” of the in-point and out-point of thematerial clip FC-001 specified as the third layer L3 are also registeredcorrespondingly to the time codes of the resultant clip FC-008.

[0253] When the special effect processing shown in FIG. 8 is instructedto the resultant clip FC-009, the editing point data shown in FIG. 16 isregistered. As shown in FIG. 16, also in the case of special effectprocessing, in the editing point data, the time code of the lower clipand the time code of the upper clip are registered correspondingly. Morespecially, as shown in FIG. 16, the time codes of the in-point and theout-point of the material clip MC-004 “00:10:12:00” and “00:12:18:00”are registered with corresponding to the time code of the resultant clipFC-009.

[0254] Further, when the edit processing shown in FIG. 9 is instructedto the resultant clip FC-010, the editing point data shown in FIG. 17 isregistered. As shown in FIG. 17, also in the case of edit processing, inthe editing point data, the time code of the lower clip and the timecode of the upper clip are registered correspondingly. More specially,as shown in FIG. 17, the time codes of the in-point and the out-point ofthe resultant clip FC-008 specified as the first layer L1 “00:01:01:20”and “00:04:43:00” are registered with corresponding to the time code ofthe resultant clip FC-010, and as shown in FIG. 17, the time codes ofthe in-point and the out-point of the resultant clip FC-009 specified asthe second layer L2 “00:00:00:50” and “00:02:06:00” are registered withcorresponding to the time code of the resultant clip FC-010.

[0255] Next, referring to FIG. 18, the composite data is explained. Thecomposite data is data for showing the composite ratio (gain) when thevideo data of the clip specified to each layer is composed, and takes avalue from “0” to “100”. In addition, if the composite data is “0”, thismeans that the video data to be composed is composed with the ratio of0%, and the video data at a lower layer is completely viewedtransparently in this case. If the value of the composite data is “50”,this means that the video data to be composed is composed with the ratioof 50%, and a half of the video data of the lower layer is viewedtransparently. If the value of the composite data is “100”, this meansthat the video data to be composed is composed with the ratio of 100%,and the video data of the lower layer is completely hidden and notviewed.

[0256] Here, the concrete example is shown in FIG. 18. FIG. 18 shows adatabase of the composite data produced when the composite data (gain)is specified by using the parameter setting window 35 shown in FIG. 10.

[0257] When the gain “100” is specified to the material clip MC-003specified to the first layer L1 at a position of the editing point EP1and a position of the editing point EP8, as shown in FIG. 18, the gain“100” is registered in the column corresponding to the editing point EP1and the editing point EP8. Further, since the section between theediting point EP1 and the editing point EP8 is linearly interpolatedbased on the value using the editing points EP1 and EP8 as key points,the gain “100” is automatically registered (in the figure, “. . . ”shows that the interpolated value is registered).

[0258] Also, when the gain “59” is specified to the material clip MC-002specified to the second layer L2 at a position of the editing point EP2,the gain “100” is specified at a position of the editing point EP3, andthe gain “0” is specified at a position of the editing point EP6, asshown in FIG. 18, the gain “59”, “100”, and “0” are respectively andsuccessively registered in the columns corresponding to the editingpoints EP2, EP3, and EP6. Also in this case, since the section betweenthe editing point EP2 and the editing point EP3 and the section betweenthe editing point EP3 and the editing point EP6 are linearlyinterpolated based on the values using the editing points EP2, EP3, andEP6 as key points, the gain values which continue linearly areautomatically registered.

[0259] Also, when the gain “100” is specified to the material clipMC-001 specified to the third layer L3 at a position of the editingpoint EP4, the gain “67” is specified at a position of the editing pointEP5 and the gain “51” is specified at a position of the editing pointEP7, as shown in FIG. 18, the gain “100”, “67”, and “51” arerespectively and successively registered in the columns corresponding tothe editing points EP4, EP5, and EP7. Also in this case, since thesection between the editing point EP4 and the editing point EP5 and thesection between the editing point EP5 and the editing point EP7 arelinearly interpolated based on the values using the editing points EP4,EP5, and EP7 as key points, the gain values which continue linearly areautomatically registered.

[0260] Thus, the composite data described above are registered toexecute the edit processing, so that the values of the composite datacan be changed at a timing of each editing point at any time. As aresult, the video image such that the video image of the material clipMC-002 specified to the layer L2 is gradually appeared on the videoimage of the material clip MC-003 specified as the layer L1 from thepoint in time of the editing point EP2, and then after the editing pointEP3, the video image of the material clip MC-002 becomes faintgradually, and at the point in time of the editing point EP4, the videoimage of the material clip MC-001 specified as the layer L3 is appeared,thereafter, it becomes faint gradually, can be obtained.

[0261] Next, referring to FIG. 19, the special effect data is explained.The special effect data is basically composed of an effect ID datashowing the type of the special effect processing applied to the clip tobe edited, each parameter value of the specified special effectprocessing, and period that the special effect processing is performed.

[0262] Here, the concrete example of the special effect processing showsin FIG. 19. FIG. 19 shows a database of the special effect data relatingto the three-dimensional transform shown in FIG. 8 and a database of thespecial effect data produced when the parameter is set by using theparameter setting window 42 shown in FIG. 11.

[0263] In FIG. 19, “1025” registered as the effect ID data is an effectidentification number assigned to the three-dimensional transform, andit can be known that the three-dimensional transform is specified as aspecial effect processing by the effect identification number “1025”.Also, “Loc X”, “Loc Y”, and “Loc Z” represent the position (X, Y, Z)being parameters of the three-dimensional transform. “Rot X”, “Rot Y”,and “Rot Z” represent the rotation direction (X, Y, Z) being parametersof the three-dimensional transform. “Asp” represents the aspect ratiobeing parameter of the three-dimensional transform. “Skew” representsthe skew being parameter of the three-dimensional transform. “Pers”represents the perspective value being parameter of thethree-dimensional transform. As shown in FIG. 19, these parameters arespecified from the editing point EP2 to the editing point EP7. Thereby,it can be easily understood that the editing point EP2 is the startingpoint and the editing point EP7 is the end point, as to the period wherethe three-dimensional transform is specified. In addition, the concretevalues of the starting point and the end point of the three-dimensionaltransform, that are the time codes, are easily obtained by referring tothe editing point data of FIG. 16 explained above.

[0264] Here, in the parameter setting window 42 shown in FIG. 11, whenthe coordinate values “0”, “0”, “−1.6”, and “−1.6” are respectivelyspecified to the parameter “Loc X” at the editing points EP2, EP4, EP6,and EP7, as shown in FIG. 19, the coordinate values “0”, “0”, “−1.6”,and “−1.6” are registered in the columns corresponding to the editingpoints EP2, EP4, EP6, and EP7. In this case, the sections between theediting point EP2 and the editing point EP4, between the editing pointEP4 and the editing point EP6, between the editing point EP6 and theediting point EP7, are linearly interpolated based on the values usingthe editing points EP2, EP4, EP6, and EP7 as key points, and thecoordinate values which continue linearly are automatically registered.

[0265] Similarly, when the coordinate values “0”, “0”, and “+2” arerespectively specified to the parameter “Loc Y” at the editing pointsEP2, EP6, and EP7, the corresponding coordinate values are registered inthe columns corresponding to the editing points EP2, EP6, and EP7. Whenthe coordinate values “0”, “+2.2”, and “+2.2” are respectively specifiedto the parameter “Loc Z” at the editing points EP2, EP6, and EP7, thecorresponding coordinate values are registered in the columnscorresponding to the editing points EP2, EP6, and EP7.

[0266] Further, when the rotation angles “0”, “−180”, and “−102” arerespectively specified to the parameter “Rot X” at the editing pointsEP2, EP5, and EP7, the corresponding rotation angles are registered inthe columns corresponding to the editing points EP2, EP5, and EP7. Inaddition, since the interpolation with a spline curve is set in thiscase, the values which continue along a spline curve are automaticallyregistered between the editing point EP2 and the editing point EP5 andbetween the editing point EP5 and the editing point EP7. Moreover,regarding to the parameters “Rot Y”, “Rot Z”, “Asp”, “Skew”, and “Pers”which are not specified, “0” is registered automatically as a defaultvalue.

[0267] In this way, when the parameters relating to thethree-dimensional transform are registered to execute the edit work, thevalues of parameters are changed at a timing of each editing point, andat the same time, changed into the interpolated values betweenrespective editing points. As a result, the video image which moves inthe three-dimensional space with rotating using the X-axis as a shaftcan be obtained.

[0268] Next, referring to FIG. 20, the edit data is explained. The editdata is basically composed of an effect ID data showing the type of thetransition effect applied to the clip to be edited, each parameter valueof the specified transition effect, and period that the transitioneffect is performed.

[0269] Here, the concrete example of the edit data shows in FIG. 20.FIG. 20 shows a database of the edit data produced when the wipeprocessing shown in FIG. 9 is specified as a transition effect and whenthe parameter is set by using the parameter setting window 52 shown inFIG. 12.

[0270] In FIG. 20, “0001” registered as the effect ID data is an effectidentification number assigned to the wipe processing that the image ofthe first video data is changed into the image of the second video datain the direction from the left side to the right side of the screen, andthe effect identification number “0001” means that the wipe processingis specified as a transition effect.

[0271] In addition, when the effect identification number “1300” isregistered as an effect ID data, it means that the wipe processing isspecified such that the image of the first video data is changed intothe image of the second video data in the direction from the both sidesof the screen to the center. When the effect identification number“2123” is registered as an effect ID data, it means that the page turnprocessing is specified such that the image of the first video data ischanged as if a page is turned.

[0272] Further, “Aspect” is a parameter indicating the ratio of lengthand breadth of wipe pattern, “Angle” is a parameter indicating the angleof wipe pattern, “Speed” is a parameter indicating the speed to change,and “H-Mod” and “V-Mod” are parameters indicating the wave of the wipepattern respectively. As shown in FIG. 20, these parameters arespecified from the editing point EP2 to the editing point EP4, thereby,it can be easily obtained that the editing point EP2 is the start pointand the editing point EP4 is the end point as a period that the wipeprocessing is specified. In addition, the concrete values of the startpoint and the end point of the wipe processing, that are time codes, canbe easily obtained by referring to the editing point data of FIG. 17explained above.

[0273] Here, when the values “0” and “+25” are respectively specified tothe parameter “Aspect” at the editing points EP2 and EP4, as shown inFIG. 20, the corresponding values are registered in the columnscorresponding to the editing points EP2 and EP4. In this case, thesection between the editing point EP2 and the editing point EP4 islinearly interpolated based on the values using the editing point EP2and the editing point EP4 as key points, and the values which continuelinearly are registered automatically.

[0274] Also, when the values “20”, “20”, and “100” are respectivelyspecified to the parameter “Speed” at the editing points EP2, EP3, andEP4, the corresponding values are registered in the columnscorresponding to the editing points EP2, EP3, and EP4. Also in thiscase, the section between the editing point EP2 and the editing pointEP3 and the section between the editing point EP3 and the editing pointEP4 are linearly interpolated based on the values using the editingpoints EP2, EP3, and EP4 as key points, and the values which continuelinearly are registered automatically.

[0275] While, when the values “0”, “+180”, and “−180” are respectivelyspecified to the parameter “Angle” at the editing points EP2, EP3, andEP4, the corresponding values are registered in the columnscorresponding to the editing points EP2, EP3, and EP4. Since theinterpolation with a spline curve is set in this case, the values whichcontinue along a spline curve are automatically registered between theediting point EP2 and the editing point EP3 and between the editingpoint EP3 and the editing point EP4. Moreover, regarding to theparameters “H-Mod” and “V-Mod” which are not specified, “0” isregistered automatically as a default value.

[0276] In this way, when the parameters relating to the wipe processingare registered to execute the edition work, the values of parameters arechanged at a timing of the editing point, and at the same time, changedinto the interpolated values between respective editing points. As aresult, the video image of the transition effect that the shape, angle,and speed of wipe pattern are changed successively can be obtained.

[0277] (6) Procedures in the Editing System

[0278] Next, in this paragraph, the operation procedure of eachprocessing in the editing system 1 will be explained using flowcharts.Note that the contents of the operation procedures explained hereinafterare all performed by the operation of a CPU 21 based on the applicationprogram.

[0279] When the editing system 1 is started up with a predeterminedmethod, the CPU 21 initially starts up the control module CNTM at stepSP1 shown in FIG. 21, and displays a top menu on the display 2B of thework station 2 at next step SP2.

[0280] At next step SP3, the CPU 21 determines whether or not any itemof menu is selected on the top menu. As a result, when the item of menuis selected, the item of menu is determined in following steps SP4 toSP7.

[0281] As the result of the determination of step SP4, when the start-upcommand of the edit module EM is selected, the CPU 21 proceeds to stepSP8 to perform the start-up processing of the edit module EM. As theresult of the determination of step SP5, when the start-up command ofthe composite module CM is selected, the CPU 21 proceeds to step SP9 toperform the startup processing of the composite module CM. As the resultof the determination of step SP6, when the start-up command of thespecial-effect module SM is selected, the CPU 21 proceeds to step SP10to perform the start-up processing of the special-effect module SM.

[0282] While, as the result of the determination of step SP7, when thecommand for opening a file of the resultant clip already registered isselected, the CPU 21 identifies the module used in the selectedresultant clip at the next step SP11 and starts up the identified module(that is, the edit module EM, the composite module CM, or the specialeffect module SM) at next step SP12. In addition, at step SP11, the CPU21 refers the work data registered in the clip database CDB, so as toidentify the module of the resultant clip selected.

[0283] Here, FIG. 22 concretely shows the start-up processing of theedit module EM at step SP8. When the edit module EM is instructed tostart up, the CPU 21 first displays the GUI of the edit module EM on thedisplay 2B of the work station 2 at step SP21 entering from step SP20.At next step SP22, the CPU 21 determines whether or not the start-up ofthe edit module EM is instructed through the above step SP12. When thestart-up of the edit module EM is instructed through step SP12, the CPU21 proceeds to step SP23 to read out the content of edit processing ofthe specified resultant clip based on the clip management dataregistered in the clip database CDB, and displays the content of theedit processing on the time line window 51 of the GUI for edit moduledescribed above.

[0284] On the other hand, as the result of the determination of stepSP22, when the start-up through step SP12 is not instructed but thenewly start-up is instructed, the CPU 21 proceeds to step SP24 toprepare the registration of the clip management data for a newly editprocessing. More specifically, the area for registering the clipmanagement data is secured on the clip database CDB in order to providethe content of the edit processing newly instructed. After theprocessing of step SP23 or step SP24 is performed, the CPU 21 proceedsto step 25 to perform the actual edit processing.

[0285] Further, FIG. 23 concretely shows the start-up processing of thecomposite module CM at step SP9. When the composite module CM isinstructed to start up, the CPU 21 first displays the GUI of thecomposite module CM on the display 2B of the work station 2 at step SP31entering from step SP30. At next step SP32, the CPU 21 determineswhether or not the start-up of the composite module CM is instructedthrough the above step SP12. When the start-up of the composite moduleCM is instructed through step SP12, the CPU 21 proceeds to step SP33 toread out the content of composite processing of the specified resultantclip based on the clip management data registered in the clip databaseCDB, and displays the content of the composite processing on the timeline window 34 of the GUI for composite module described above.

[0286] On the other hand, as the result of the determination of stepSP32, when the start-up through step SP12 is not instructed but thenewly start-up is instructed, the CPU 21 proceeds to step SP34 toprepare the registration of the clip management data for a newlycomposite processing. More specifically, the area for registering theclip management data is secured on the clip database CDB in order toprovide the content of the composite processing newly instructed. Afterthe processing of step SP33 or step SP34 is performed, the CPU 21proceeds to step 35 to perform the actual composite processing.

[0287] Further, FIG. 24 concretely shows the start-up processing of thespecial effect module SM at step SP10. When the special effect module SMis instructed to start up, the CPU 21 first displays the GUI of thespecial effect module SM on the display 2B of the work station 2 at stepSP41 entering from step SP40. At next step SP42, the CPU 21 determineswhether or not the start-up of the special effect module SM isinstructed through the above step SP12. When the start-up of the specialeffect module SM is instructed through step SP12, the CPU 21 proceeds tostep SP43 to read out the content of special-effect processing of thespecified resultant clip based on the clip management data registered inthe clip database CDB, and displays the content of the special effectprocessing on the time line window 41 of the GUI for special effectmodule described above.

[0288] On the other hand, as the result of the determination of stepSP42, when the start-up through step SP12 is not instructed but thenewly start-up is instructed, the CPU 21 proceeds to step SP44 toprepare the registration of the clip management data for a newly specialeffect processing. More specifically, the area for registering the clipmanagement data is secured on the clip database CDB in order to providethe content of the special effect processing newly instructed. After theprocessing of step SP43 or step SP44 is performed, the CPU 21 proceedsto step 45 to perform the actual special effect processing.

[0289] Here, the details of the edit processing at the step SP25 of FIG.22 are illustrated in FIG. 25. Note that the figure is omitted, but thecomposite processing at step SP35 of FIG. 23 and the special effectprocessing at step SP45 of FIG. 24 are mostly same as that of the editprocessing of FIG. 25. The difference is only that the content of theedit processing is changed into that of the composite processing or thespecial effect processing.

[0290] As shown in FIG. 25, the CPU 21 first determines whether or notan input for instructing the edit processing is supplied at step SP51entering from step SP50 (e.g., determines whether or not the operationusing the time line window 51 or the operation using the parametersetting window 52 exists). As a result, when the input is supplied, theCPU 21 proceeds to step S52, so that edit data corresponding to theinput is produced to suitably write it in the clip database CDB as aclip management data, and the enable/disable flag of the resultant clipis set to disable. If the input is to read out the resultant clipalready registered and modify the content thereof, the CPU 21 dose notonly overwrite, but also assigns another code to the clip managementdata before modification and maintains it in the other area. Thus, theclip management data before modification can be read later.

[0291] When the processing of step SP52 is completed, the CPU 21proceeds to next step SP53. At step SP53, the CPU 21 refers the parentlink ID code of the clip management data, so as to determine whether ornot the upper clip of the clip management data exists. As a result, whenthere is no upper clip, the CPU 21 returns to step SP51. When the upperclip exists, the CPU 21 proceeds to step SP54 to set the enable/disableflag of the clip management data for managing the upper clip to disable,thereafter, returns to step SP51. In addition, the case of proceeding tothe step SP54 is mostly when the resultant clip already registered ismodified. Further, the upper clip includes not only the upper cliphaving the resultant clip produced at step SP52 as a lower clip, butalso includes the resultant clip having this upper clip further as alower clip and at least all resultant clips using this resultant clip asa material (hereinafter, referred to as associated clips).

[0292] For example, it is assumed that the relation between eachmaterial clip and the resultant clip is as shown in FIG. 26. Morespecifically, a resultant clip FC-G is produced from material clipsMC-G1 and MC-G2, and a resultant clip FC-E is produced from theresultant clip FC-G and material clips MC-E1 and MC-E2 as materials. Aresultant clip FC-C is produced from the resultant clip FC-E and amaterial clip MC-C1 as materials.

[0293] Further, a resultant clip FC-F is produced from material clipsMC-F1, MC-F2, and MC-F3 as materials, and a resultant clip FC-D isproduced from the resultant clip FC-F and material clips MC-D1 and MC-D2as materials. Furthermore, the resultant clip FC-B is produced from theresultant clips FC-D and FC-C and material clip MC-B1 as materials, anda resultant clip FC-A is produced from the resultant clip FC-B as amaterial.

[0294] When there is such relation between clips, as far as themodification is not added after the clip video data of the respectiveresultant clips are produced once, the enable/disable flag of the clipmanagement data for managing these clips is normally set to enable.However, the content of the edit processing of the resultant clip FC-Eis modified for example, the enable/disable flag of the resultant clipFC-E is naturally set to disable. The enable/disable flag are set todisable not only for the resultant clip FC-E but also for the resultantclips FC-C and FC-D which have the resultant clip FC-E as a lower clip,the resultant clip FC-B having the resultant clips FC-C and FC-D aslower clips, and moreover, the resultant clip FC-A having the resultantclip FC-B as a lower clip.

[0295] The flowchart shown in FIG. 25 is explained again. As the resultof the determination of step SP51, in the case where the edit processingis not inputted specially, the CPU 21 proceeds to next step SP55. Atstep SP55, the CPU 21 determines whether or not the resultant clipdisplayed at the video area of the time line window 51 has beenselected. When the displayed resultant clip has been selected, the CPU21 starts up the module which has produced the resultant clip (i.e., thecomposite module CM or the special effect module SM) at step SP56. Whenthe displayed resultant clip is not selected, the CPU 21 proceeds tostep SP58. Note that the details of step SP56 will be described later.

[0296] At step SP58, the CPU 21 determines whether or not there-execution instruction is input, and when it is input, proceeds tostep SP59 to perform the re-execution processing. When the re-executioninstruction is not input, the CPU 21 returns to the original flowchartthrough step SP26. In addition, the re-execution described here meansthat the view button or the all view button displayed on the GUI screenis clicked by the mouse 2D and the instruction of the view or all viewis input. At the time of the view or all view, the content of thespecified edit processing is actually executed to produce the video clipdata of the resultant clip, so that such name is given.

[0297] Here, the concrete processing of the step SP56 described above(that is, the start-up processing of the module) is shown in FIG. 27. Asshown in FIG. 27, when the displayed resultant clip is selected, the CPU21 reads out the clip management data of the selected resultant clip atstep SP61 entering from step SP60. Next, at step SP62, the CPU 21 refersa module ID code registered in the clip management data and starts upthe module corresponding to the module ID code (that is, the compositemodule CM or the special effect module SM) at step SP63, to display thecontent of the edit processing of the resultant clip on the time linewindow of the GUI.

[0298] Then, the concrete processing of step SP59 described above (i.e.,the re-execution processing) is shown in FIG. 28. However, in FIG. 28,there is the relation between clips shown in FIG. 26, and at the sametime the resultant clips FC-E, FC-D, FC-C, FC-B, and FC-A are alldisable by the processing of step SP54 explained above.

[0299] As shown in FIG. 28, when the re-execution is instructed, the CPU21 forms a stack memory on the RAM 21B and pushes the clip managementdata of the resultant clip positioned at the uppermost of the clip treeonto the stack memory. For example, in the example shown in FIG. 26,since the resultant clip FC-A is at the uppermost position, the clipmanagement data of the resultant clip FC-A is pushed on the stackmemory. Note that pushing means that data is piled up in the stackmemory space.

[0300] At next step SP72, the CPU 21 determines whether or not the stackmemory is empty. In the present state, at step SP71, data exists sincethe clip management data is pushed onto the stack memory, so that thenegative result is obtained. Thereby, the CPU 21 proceeds to step SP74.

[0301] At step SP74, the CPU 21 pops the clip management data for oneclip from the stack memory, and determines whether or not the clip isenable based on the enable/disable flag of the clip management data. Inthe example shown in FIG. 26, since the resultant clip FC-A is disable,the negative result is obtained and the CPU 21 proceeds to step SP75.Note that popping means that the data piled up in the stack memory spaceis read out from the uppermost data.

[0302] At step SP75, the CPU 21 determines whether or not the lower clipof the resultant clip is all enable based on the clip management dataread out at the former step SP74. In this case, the CPU 21 refers thechild link ID code registered in the clip management data of theresultant clip to determine the lower clip based on the clip ID coderegistered there, and refers the enable/disable flag of the lower clipfrom the clip database to determine whether or not the lower clips areall enable clips. In the example shown in FIG. 26, the resultant clipFC-B being the lower clip of the resultant clip FC-A is disable, so thatthe negative result is obtained and the CPU 21 proceeds to next stepSP77.

[0303] At step SP77, the CPU 21 pushes again the clip management data ofthe resultant clip popped before, and proceeds to next step SP78. In theexample shown in FIG. 26, the clip management data of the resultant clipFC-A is pushed again onto the stack memory. At step SP78, the CPU 21pushes one clip management data of the disable clip among the lowerclips of the resultant clip re-pushed at step SP77 onto the stackmemory. In the example shown in FIG. 26, the lower clip FC-B of theresultant clip FC-A is disable, so that the clip management data of theresultant clip FC-B is pushed onto the stack memory.

[0304] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, since the clipmanagement data exists in the stack memory, the negative result isobtained and proceeds to step SP74. At step SP74, the CPU 21 pops theclip management data for one clip from the stack memory, and determineswhether or not the clip is enable based on the enable/disable flag ofthe clip management data. In the example shown in FIG. 26, since theclip management data of the resultant clip FC-B is read out but theresultant clip FC-B is disable, the negative result is obtained andproceeds to step SP75.

[0305] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,the resultant clips FC-C and FC-D being the lower clips of the resultantclip FC-B is disable, so that the negative result is obtained andproceeds to step SP77.

[0306] At step SP77, the CPU 21 pushes again the clip management data ofthe resultant clip popped before, and proceeds to next step SP78. In theexample shown in FIG. 26, the clip management data of the resultant clipFC-B is pushed again. At next step SP78, the CPU 21 pushes one clipmanagement data of the disable clip among the lower clips of theresultant clip re-pushed at step SP77 onto the stack memory. In theexample shown in FIG. 26, the clip management data of the resultant clipFC-C is pushed.

[0307] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the negativeresult is obtained since it is not empty, and proceeds to step SP74. Atstep SP74, the CPU 21 pops the clip management data for one clip fromthe stack memory, and determines whether or not the resultant clip isenable based on the clip management data. In the example shown in FIG.26, since the clip management data of the resultant clip FC-C is readout but the resultant clip FC-C is disable, the negative result isobtained and proceeds to step SP75.

[0308] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,the resultant clip FC-E being the lower clip of the resultant clip FC-Cis disable, so that the negative result is obtained and proceeds to stepSP77.

[0309] At step SP77, the CPU 21 pushes again the clip management data ofthe resultant clip popped before onto the stack memory, and proceeds tonext step SP78. In the example shown in FIG. 26, the clip managementdata of the resultant clip FC-C is pushed again. At next step SP78, theCPU 21 pushes one clip management data of the disable clip among thelower clips of the resultant clip re-pushed at step SP77 onto the stackmemory. In the example shown in FIG. 26, the clip management data of theresultant clip FC-E is pushed.

[0310] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the negativeresult is obtained since it is not empty, and proceeds to next stepSP74. At step SP74, the CPU 21 pops the clip management data for oneclip from the stack memory, and determines whether or not the resultantclip is enable based on the clip management data. In the example shownin FIG. 26, since the resultant clip FC-E is read out but the resultantclip FC-E is disable, the negative result is obtained to proceed to stepSP75.

[0311] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,since the clips MC-E1, MC-E2, and FC-G which are lower clips of theresultant clip FC-E are all enable, the affirmative result is obtained,and proceeds to step SP76.

[0312] At step SP76, the CPU 21 performs the edit processing using theclip video data of the clip specified as a material based on the workdata registered in the clip management data, so as to produce the clipvideo data of the resultant clip and changes the enable/disable flag ofthe clip management data of the resultant clip into enable. In theexample shown in FIG. 26, the edit processing is performed by using theclips FC-G, MC-E1, and MC-E2 specified as materials to produce the clipvideo data of the resultant clip FC-E and change the enable/disable flagof the resultant clip FC-E into enable.

[0313] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the negativeresult is obtained since it is not empty, and proceeds to step SP74. Atstep SP74, the CPU 21 pops the clip management data for one clip fromthe stack memory, and determines whether or not the resultant clip isenable based on the clip management data. In the example shown in FIG.26, since the clip management data of the resultant clip FC-C is readout but the resultant clip FC-C is disable, the negative result isobtained and proceeds to step SP75.

[0314] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,the clips FC-E and MC-C1 being the lower clips of the resultant clipsFC-C are enable, so that the affirmative result is obtained and proceedsto step SP76.

[0315] At step SP76, the CPU 21 performs the edit processing using theclip video data of the clip specified as a material based on the workdata registered in the clip management data, so as to produce the clipvideo data of the resultant clip and changes the enable/disable flag ofthe clip management data of the resultant clip into enable. In theexample shown in FIG. 26, the edit processing is performed by using theclips FC-E and MC-C1 to produce the clip video data of the resultantclip FC-C and change the enable/disable flag of the resultant clip FC-Cinto enable.

[0316] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the negativeresult is obtained since it is not empty, and proceeds to step SP74. Atstep SP74, the CPU 21 pops the clip management data for one clip fromthe stack memory, and determines whether or not the resultant clip isenable based on the clip management data. In the example shown in FIG.26, since the clip management data of the resultant clip FC-B is readout but the resultant clip FC-B is disable, the negative result isobtained and proceeds to step SP75.

[0317] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,the resultant clip FC-D being the lower clip is disable, so that thenegative result is obtained and proceeds to step SP77.

[0318] At step SP77, the CPU 21 pushes again the clip management data ofthe resultant clip onto the stack memory similarly, and at next stepSP78, pushes the clip management data of the disable lower clip onto thestack memory.

[0319] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the negativeresult is obtained since it is not empty, and proceeds to step SP74. Atstep SP74, the CPU 21 pops the clip management data for one clip fromthe stack memory, and determines whether or not the resultant clip isenable based on the clip management data. In the example shown in FIG.26, since the resultant clip FC-D is read out but the resultant clipFC-D is disable, the negative result is obtained and proceeds to stepSP75.

[0320] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,the clips FC-E, FC-F, MC-D1 and MC-D2 being lower clips of the resultantclip FC-D are all enable, so that the affirmative result is obtained andproceeds to step SP76.

[0321] At step SP76, the CPU 21 performs the edit processing using theclip video data of the clip specified as a material based on the workdata registered in the clip management data, so as to produce the clipvideo data of the resultant clip and changes the enable/disable flag ofthe clip management data of the resultant clip into enable. In theexample shown in FIG. 26, the edit processing is performed by using theclips FC-E, FC-F, MC-D1 and MC-D2 to produce the clip video data of theresultant clip FC-D and change the enable/disable flag of the resultantclip FC-D into enable.

[0322] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the negativeresult is obtained since it is not empty, and proceeds to step SP74. Atstep SP74, the CPU 21 pops the clip management data for one clip fromthe stack memory, and determines whether or not the resultant clip isenable based on the clip management data. In the example shown in FIG.26, since the clip management data of the resultant clip FC-B is readout but the resultant clip FC-B is disable, the negative result isobtained and proceeds to step SP75.

[0323] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,the resultant clips FC-C and FC-D being lower clips are enable, so thatthe affirmative result is obtained and proceeds to step SP76.

[0324] At step SP76, the CPU 21 performs the edit processing using theclip video data of the clip specified as a material based on the workdata registered in the clip management data, so as to produce the clipvideo data of the resultant clip and changes the enable/disable flag ofthe clip management data of the resultant clip into enable. In theexample shown in FIG. 26, the edit processing is performed by using theclips FC-C and FC-D to produce the clip video data of the resultant clipFC-B and change the enable/disable flag of the resultant clip FC-B intoenable.

[0325] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the negativeresult is obtained since it is not empty, and proceeds to step SP74. Atstep SP74, the CPU 21 pops the clip management data for one clip fromthe stack memory, and determines whether or not the resultant clip isenable based on the clip management data. In the example shown in FIG.26, since the clip management data of the resultant clip FC-A is readout but the resultant clip FC-A is disable, the negative result isobtained and proceeds to step SP75.

[0326] At step SP75, the CPU 21 determines whether or not the lowerclips of the resultant clip are all enable based on the clip managementdata read out at the former step SP74. In the example shown in FIG. 26,the resultant clip FC-B being lower clip is enable, so that theaffirmative result is obtained and proceeds to step SP76.

[0327] At step SP76, the CPU 21 performs the edit processing using theclip video data of the clip specified as a material based on the workdata registered in the clip management data, so as to produce the clipvideo data of the resultant clip and changes the enable/disable flag ofthe clip management data of the resultant clip into enable. In theexample shown in FIG. 26, the edit processing is performed by using theresultant clip FC-B to produce the clip video data of the resultant clipFC-A and change the enable/disable flag of the resultant clip FC-A intoenable.

[0328] Next, the CPU 21 returns to step SP72 again to determine whetheror not the stack memory is empty. In the present state, the stack memoryis empty since the all data to the uppermost resultant clip are read outby pop processing described above, and an affirmative result isobtained. Therefore, the CPU 21 proceeds to step SP73 to complete there-execution processing.

[0329] In addition, at step SP74, if-it is determined that the clip ofthe clip management data read from the stack memory is enable, the CPU21 returns to step SP72. For example, when the uppermost resultant clipis enable in the clip tree, the clip management data is pushed onto thestack memory by the processing of step SP71. However, since theaffirmative result is obtained by determination of step SP74, the CPU 21returns to step SP72 to complete the re-execution processing immediatelybecause the affirmative result is obtained. In this way, when theuppermost resultant clip is enable, the re-execution processing is notperformed actually.

[0330] Here, the content of the flowchart of the re-execution processingdescribed above is shown in FIG. 29 schematically. In the editing system1 according to this invention, when the uppermost resultant clip FC-A isdisable, it is determined whether the resultant clip FC-B which is thelower clip of the clip FC-A is enable or not, and when it is disable, itis determined whether the clip FC-C which is the lower clip of the clipFC-B is enable or not. As a result, when the resultant clip FC-C isdisable, it is determined whether the clip FC-E which is the lower clipof the resultant clip FC-C is enable or not, and when the resultant clipFC-E is disable, it is determined whether the clip FC-G which is thelower clip of the resultant clip FC-E is enable or not.

[0331] As a result, if the resultant clip FC-G is enable, the clip videodata of the resultant clip is transferred to execute the edit processingbased on the clip video data again, so as to produce the clip video dataof the resultant clip FC-E corresponding to the upper clip. When theclip video data of the resultant clip FC-E is produced, the editprocessing based on the clip video data is executed again, so as toproduce the clip video data of the resultant clip FC-C corresponding tothe upper clip. When the clip video data of the resultant clip FC-C isproduced, the edit processing based on the clip video data is tried tobe executed again. However, since the resultant clip FC-D which is theother lower clip is still disable, it is determined whether theresultant clip FC-E which is the lower clip of the resultant clip FC-Dis enable or not.

[0332] If the resultant clip FC-E is enable, the clip video data of theresultant clip FC-E is transferred. Also, it is determined whether theresultant clip FC-F which is the other lower clip of the resultant clipFC-D is enable or not, and when it is enable, the clip video data of theresultant clip FC-F is also transferred. When the clip video data fromthe lower clips FC-E and FC-F are transferred, the edit processing basedon the clip video data is executed again, so as to produce the clipvideo data of the resultant clip FC-D corresponding to the upper clip.Next, when the clip video data of the resultant clip FC-D is produced,the edit processing based on the clip video data is executed again, soas to produce the clip video data of the resultant clip FC-Bcorresponding to the upper clip. Next, when the clip video data of theresultant clip FC-B is produced, the edit processing based on the clipvideo data is executed again, so as to produce the clip video data ofthe resultant clip FC-A corresponding to the upper clip.

[0333] In this way, in the editing system 1 according to this invention,if the content of the edit processing of the resultant clip FC-E ismodified, the flag for identifying the resultant clip FC-E is changed todisable and the flags for identifying the resultant clips FC-C, FC-D,FC-B, and FC-A which are linked to the upper position of the resultantclip FC-E are all changed to disable. Then, the re-execution processingis specified by selecting the command of the view or the all view, isdetermined whether the clips is enable or not from the uppermostresultant clip FC-A toward the lower clips. When reached to the cliphaving all enable clips linked at the lower position, the editprocessing of the clip is re-executed to change the clip into the enableclip, and the edit processing of the clip which are linked at the upperposition is successively re-executed to change all clips which arelinked at the upper position into enable clips. Thus, in the editingsystem 1 according to this invention, such processing is performed so asto easily modify the edit result once produced, even if the operatordoes not remember the relation between clips conventionally.

[0334] (7) Operation and Effect of the Editing System

[0335] With the above construction, when the editing system 1 is startedup, the top menu is displayed on the display 2B of the work station 2.An operator selects the command of starting up a desired module on thetop menu, and starts up the module suitable to the edit work which willbe performed. When the module is started up, the GUI for editing isdisplayed on the display 2B of the work station 2.

[0336] For example, when the composite module CM is started up, the GUIshown in FIG. 10 is displayed on the display 2B in the GUI for compositeprocessing, the time line window 34 only for the composite processing isdisplayed, and the clip being a material can be easily specified or adesired composite processing can be specified. At this time, in the GUI,the clips registered as the clip database CDB are displayed on the cliptree window 31 or the library window 33, and if a desired clip isselected among from these clips as a material and placed at the videoarea of the time line window 34, the material of composite processingcan be easily specified.

[0337] Further, to set the parameter of the composite processingspecified on the time line window 34, the parameter is set with viewingthe screen by using the parameter setting window 35 displayed on thesame GUI, so that a desired composite parameter can be set.

[0338] Further, on the clip tree window 31, the clip tree such that therelation between respective clips registered in the clip database CDB isunderstood is displayed. When viewing the clip tree, it can be easilyobtained that which of clips is each clip produced from as a material.

[0339] Similarly, when the special effect module SM is started up, theGUI shown in FIG. 11 is displayed on the display 2B. Also in the GUI ofthe special effect processing, the time line window 41 only for thespecial effect is displayed, and if you operates in accordance with thetime line window 41, the clip being a material can be easily specifiedor a desired special effect processing can be specified. Moreover, alsoin the GUI of the special effect processing, the clip tree window 31 andthe library window 33 are provided, so that the desired clip registeredin the clip database CDB can be easily selected as a material.

[0340] Similarly, when the edit module EM is started up, the GUI shownin FIG. 12 is displayed on the display 2B. Also in the GUI of the editprocessing, the time line window 51 only for the edit processing isdisplayed, and if you operates in accordance with the time line window51, the clip being a material can be easily specified or a desired editprocessing can be specified.

[0341] In this way, in the editing system 1, the desired material or theedit content is specified with viewing the GUI displayed on the display2B of the work station 2, so as to easily perform the desired edit work.Further, in the editing system 1, various instructions relating to theedit work can be input through the work station 2, and the edit work canbe performed easily even if the operator does not operate intentionallyvarious devices as a conventional way.

[0342] Therefore, in the editing system 1, the edit work can beperformed easier and higher in speed as compared with the conventionalone. Also, the many types of materials registered in the clip databaseCDB are used to obtain the complicated and high quality video data.

[0343] On the other hand, in the editing system 1, each clip being as amaterial is managed with the hierarchical structure based on therelation between clips. More specifically, it is understood that whichof clips is the clip linked to. Therefore, even if the content of theedit is changed after the edit work has been performed once, theassociated clips can be changed automatically by the management of thehierarchical structure. Thereby, the edit work can be easily changed andthe edit work is performed efficiently even if the operator does notintentionally remember the relation between clips. Furthermore, even ifthe edit content is changed, the original work data relating to the editis remained so as to return it to the original state after the editcontent has been changed. Further, the relation between clips is managedwith the hierarchical structure, so that the edit work is successivelyperformed based on the relation between clips managed with thehierarchical structure to perform the complicated edit work easily.

[0344] In accordance with the above construction, the work station 2displaying the GUI for each function is provided to enable to input thevarious edit instructions in accordance with the screen of the GUI, sothat the desired edit work can be performed without the operation ofdevices as conventional one, and the editing system which significantlyimproves the usability can be realized.

[0345] Further, respective clips being as materials are managed with thehierarchical structure based on the relation between clips, so that thecomplete edit work can be performed easily and the edit work can bechanged easily, thereby the editing system which can perform thecomplicated edit work easily and rapidly can be realized.

[0346] Industrial Applicability

[0347] In the broadcasting station, etc., this invention can be utilizedin the complicated edit work using a plurality of materials.

1. An editing system for producing edit resultant clip from a pluralityof clips to be edited, comprising: editing means, which is composed of aplurality of processing modules for editing the clips to be edited, forperforming on a plurality of clips to be edited the edit processingcorresponding to the processing module selected among from the pluralityof processing modules to produce edit resultant clip; managing means formanaging said edit resultant clip and said plurality of clips to beedited with the hierarchical structure, in order to show that which ofclips to be edited is said edit resultant clip produced from; andcontrol means for controlling said editing means based on theinformation managed by said managing means.
 2. The editing systemaccording to claim 1 , wherein said managing means has a clip databaseto register for each clip the information of a plurality of said clips.3. The editing system according to claim 2 , wherein said clip databaseincludes the link information indicating the link state of said clipsmanaged with the hierarchical structure.
 4. The editing system accordingto claim 3 , wherein said link information registered for each clipconsists of the lower link information indicating the lower clips linkedto said clip at a lower position and the upper link informationindicating the upper clips linked to said clip at an upper position. 5.The editing system according to claim 4 , wherein said managing meansregister said clips to be edited in said clip database as a lower clipof said edit resultant clip, so as to correspond to the layer specifiedin the processing module and corresponding to said edit resultant clip.6. The editing system according to claim 4 , wherein: said plurality ofclips to be edited include the first clip to be edited and the secondclip to be edited; and said managing means register said first clip tobe edited in said clip database as a lower clip firstly linked to saidedit resultant clip and registers said second clip to be edited in saidclip database as a lower clip secondly linked to said edit resultantclip, when said first clip to be edited is specified as the first layerand said second clip to be edited is specified as the second layer inthe processing module selected in producing said edit resultant clip. 7.The editing system according to claim 2 , wherein: said plurality ofprocessing modules comprise an edit module for editing said editresultant clip, a composite module for composing said edit resultantclip, and a special effect module for applying a special effect to saidedit resultant clip.
 8. The editing system according to claim 7 ,further comprising image processing means for applying the imageprocessing respectively corresponding to said edit module, saidcomposite module, and said special effect module to the video data ofsaid clip to be edited.
 9. The editing system according to claim 8 ,further comprising display means for displaying the graphical userinterface respectively corresponding to said edit module, said compositemodule, and said special effect module on a display.
 10. The editingsystem according to claim 8 , wherein said clip database has the moduleidentification information indicating that which of said plurality ofprocessing modules is said edit resultant clip produced among from. 11.The editing system according to claim 10 , wherein said control meanscontrols said editing means and said image processing means based on theinformation registered in said clip database.
 12. The editing systemaccording to claim 10 , wherein said control means controls said editingmeans based on said module identification information of the editresultant clip specified by an edit operator.
 13. The editing systemaccording to claim 10 , wherein said control means controls said editingmeans so as to start up the processing module corresponding to the editresultant clip specified by an edit operator based on said moduleidentification information stored in said clip database.
 14. The editingsystem according to claim 10 , wherein said clip database has edit pointdata indicating a plurality of editing points specified in producingsaid edit resultant clip and image processing data indicating the imageprocessing applied to the video data of said clip to be edited toproduce said edit resultant clip.
 15. The editing system according toclaim 14 , wherein said control means controls the image processingtiming of said image processing means based on said editing point dataregistered in said clip database, and controls the image processingoperation of said image processing means.
 16. The editing systemaccording to claim 14 , wherein said editing point data is datarepresenting the edit start point and the edit end point of said clip tobe edited, and data representing the change point of said imageprocessing data applied to the video data of said edit resultant clip.17. The editing system according to claim 16 , wherein said editingpoint data is represented by time code in said edit resultant clip andtime code in said clip to be edited.
 18. The editing system according toclaim 17 , wherein the time code representing the editing point in saidclip to be edited is stored in said clip database so as to be associatedwith the time code indicating the editing point specified in said editresultant clip.
 19. The editing system according to claim 16 , wherein:said edit resultant clip and said clip to be edited respectively havethe original time code starting from the start point of each clip; andsaid managing means registers, at the edit start point of said clip tobe edited, in said clip database as said editing point data the timecode in said edit resultant clip and the time code in said clip to beedited which are associated each other, and registers at the edit endpoint of said clip to be edited in said clip database as said editingpoint data the time code in said edit resultant clip and the time codein said clip to be edited which are associated each other.
 20. Theediting system according to claim 14 , wherein said image processingdata consists of edit processing data indicating the content of theimage processing corresponding to the edit processing specified by saidedit module, the composite processing data indicating the content of theimage processing corresponding to the composite processing specified bysaid composite module, and the special effect processing data indicatingthe content of the image processing corresponding to the special effectprocessing specified by said special effect module.
 21. The editingsystem according to claim 20 , wherein said edit data consists of editprocessing identification data indicating the type of edit processingset by said edit module and a plurality of edit processing parameterscorresponding to the edit processing.
 22. The editing system accordingto claim 21 , wherein said edit processing parameters are registered insaid clip database so as to correspond to said editing point specifiedin said edit resultant clip.
 23. The editing system according to claim22 , wherein said control means controls said image processing means soas to perform on the video data of said clip to be edited the imageprocessing in accordance with said edit processing parameterscorresponding to said editing point at a timing in accordance with saidediting point.
 24. The editing system according to claim 22 , wherein:the editing point specified for said edit resultant clip includes thefirst editing point and the second editing point; said edit processingparameters include the first edit processing parameter set to a timingcorresponding to said first editing point and the second edit processingparameter set to a timing corresponding to said second editing point;and said control means controls said image processing means so as toperform the image processing in accordance with said first editparameter on the video data of said clip to be edited at a timing ofsaid first editing point, and controls said image processing means so asto perform the image processing in accordance with said second editparameter on the video data of said clip to be edited at a timing ofsaid second editing point.
 25. The editing system according to claim 24, wherein said control means controls said image processing means so asto perform the image processing in accordance with the interpolationparameter interpolated between said first edit parameter and said secondedit parameter on the video data of said clip to be edited during theperiod from said first editing point to said second editing point. 26.The editing system according to claim 21 , wherein said control meansfurther has display means for displaying the cell showing the editsection of said clip to be edited and the change of said edit processingparameters specified for said clip to be edited, which correspond to thetime axis direction.
 27. The editing system according to claim 20 ,wherein said composite processing data consists of a plurality ofcomposite processing parameters corresponding to the compositeprocessing set by said composite module.
 28. The editing systemaccording to claim 27 , wherein said plurality of composite processingparameters are registered in said clip database so as to correspond tosaid editing point specified in said edit resultant clip.
 29. Theediting system according to claim 28 , wherein said control meanscontrols said image processing means so as to perform on the video dataof said clip to be edited the image processing in accordance with saidcomposite processing parameters corresponding to said editing point at atiming in accordance with said editing point.
 30. The editing systemaccording to claim 28 , wherein: the editing point specified for saidedit resultant clip includes the first editing point and the secondediting point; said composite processing parameters include the firstcomposite processing parameter set to a timing corresponding to saidfirst editing point and the second composite processing parameter set toa timing corresponding to said second editing point; and said controlmeans controls said image processing means so as to perform the imageprocessing in accordance with said first composite parameter on thevideo data of said clip to be edited at a timing of said first editingpoint, and controls said image processing means so as to perform theimage processing in accordance with said second composite parameter onthe video data of said clip to be edited at a timing of said secondediting point.
 31. The editing system according to claim 30 , whereinsaid control means produces a plurality of interpolation parametersbased on said first composite processing parameter and said secondcomposite processing parameter, and controls said image processing meansso as to perform the image processing in accordance with said pluralityof interpolation parameters during the period from said first editingpoint to said second editing point.
 32. The editing system according toclaim 31 , wherein said control means further has display means fordisplaying the cell showing the edit section of said clip to be editedand the change of said composite processing parameters specified forsaid clip to be edited, which correspond to the time axis direction. 33.The editing system according to claim 20 , wherein said special effectprocessing data consists of special effect identification dataindicating the type of special effect processing set by said specialeffect module, and a plurality of special effect parameterscorresponding to said special effect processing.
 34. The editing systemaccording to claim 33 , wherein said plurality of special effectprocessing parameters are registered in said clip database so as tocorrespond to said plurality of editing points specified in said editresultant clip.
 35. The editing system according to claim 34 , whereinsaid control means controls said image processing means so as to performon the video data of said clip to be edited the image processing inaccordance with said special effect processing parameters correspondingto said editing point at a timing in accordance with said editing point.36. The editing system according to claim 34 , wherein: the editingpoint specified for said edit resultant clip includes the first editingpoint and the second editing point; said special effect processingparameters include the first special effect processing parameter set toa timing corresponding to said first editing point and the secondspecial effect processing parameter set to a timing corresponding tosaid second editing point; and said control means controls said imageprocessing means so as to perform the image processing in accordancewith said first special effect parameter on the video data of said clipto be edited at a timing of said first editing point, and controls saidimage processing means so as to perform the image processing inaccordance with said second special effect parameter on the video dataof said clip to be edited at a timing of said second editing point. 37.The editing system according to claim 36 , wherein said control meansproduces a plurality of interpolation parameters based on said firstspecial effect processing parameter and said second special effectprocessing parameter, and controls said image processing means so as toperform the image processing in accordance with said plurality ofinterpolation parameters during the period from said first editing pointto said second editing point.
 38. The editing system according to claim37 , wherein said control means further has display means for displayingthe cell showing the edit section of said clip to be edited and thechange of said special effect processing parameters specified for saidclip to be edited, which correspond to the time axis direction.
 39. Theediting system according to claim 14 , wherein said control means makesall clips linked to the upper position of the modified edit resultantclip disable, when said edit resultant clip registered in said clipdatabase is modified.
 40. The editing system according to claim 14 ,wherein said control means produces a new edit resultant clip instead ofthe edit resultant clip before modification when said edit resultantclip is modified, and makes all clips linked to the upper position ofthe edit resultant clip before modification disable.
 41. The editingsystem according to claim 40 , wherein said database has theidentification flag indicating whether said each clip is enable ordisable.
 42. The editing system according to claim 40 , wherein saidmanaging means, registers said new edit resultant clip in said clipdatabase with the clip identification code or clip name representingsaid edit resultant clip before modification, and registers said editresultant clip before modification in said clip database with the clipidentification code or clip name which is different from the clipidentification code or clip name representing said edit resultant clipbefore modification.
 43. The editing system according to claim 14 ,wherein said control means produces a new edit resultant clip instead ofsaid edit resultant clip before modification when said edit resultantclip is modified, and searches all clips linked to the upper position ofsaid edit resultant clip before modification based on said linkinformation of said clip database to make the searched clips disable.44. The editing system according to claim 43 , wherein said managingmeans, registers the information relating to said new edit resultantclip in said clip database with the clip identification code or clipname representing said edit resultant clip before modification, andregisters the information relating to said edit resultant clip beforemodification in said clip database with the clip identification code orclip name which is different from the clip identification code or clipname representing said edit resultant clip before modification.
 45. Theediting system according to claim 44 , wherein said clip database hasthe identification flag indicating whether said each clip is enable ordisable.
 46. The editing system according to claim 45 , wherein saidcontrol means has re-execution means for re-executing in order to makesaid edit resultant clip which has been made disable by the modificationprocessing enable.
 47. The editing system according to claim 46 ,wherein said re-execution means having: search process for referringsaid link information and said identification flag of said clip databaseto search the edit resultant clip to be re-executed among from saiddisable edit resultant clips; and production process for producing a newvideo data corresponding to said searched edit resultant clip among fromthe video data of all lower clips linked to the lower position of theedit resultant clip searched by said search process.
 48. The editingsystem according to claim 47 , wherein said re-execution means, in saidproduction process, produces a new edit resultant clip instead of saidsearched disable edit resultant clip, from said newly produced videodata, said link information relating to said searched edit resultantclip registered in said clip database, said editing point data, and saidimage processing data.
 49. The editing system according to claim 48 ,wherein said managing means registers said edit resultant clip newlyproduced in said clip database with the clip identification code or clipname representing said searched disable edit resultant clip, andregisters said searched disable edit resultant clip in said clipdatabase with the clip identification code or clip name which isdifferent from the clip identification code or clip name representingsaid researched disable edit resultant clip.
 50. The editing systemaccording to claim 47 , wherein said re-execution means repeats saidsearch process and said production process until all clips managed withthe hierarchical structure by said managing means become enable.
 51. Theediting system according to claim 47 , wherein said re-execution meansperforms the re-execution on the edit resultant clip which has the lowerclips being all enable among said disable edit resultant clips and whichis at the lowest position among said clips managed with saidhierarchical structure.
 52. The editing system according to claim 47 ,wherein said re-execution means, in said production process, controlssaid image processing device based on the editing point data and theimage processing data corresponding to said searched disable editresultant clip, so as to produce said new video data.
 53. An editingsystem for editing a plurality of clips to be edited, comprising:editing means, which is composed of a plurality of processing modulesfor editing the clips to be edited, for applying to a plurality of clipsto be edited the edit processing corresponding to the processing moduleselected among from the plurality of processing modules to produce editresultant clip; storing means for storing the module identificationinformation indicating that which of processing modules is said editresultant clip produced by using from; and control means for starting upthe processing module corresponding to said edit resultant clip based onsaid module identification data stored in said storing means, when saidedit resultant clip is selected.
 54. The editing system according toclaim 53 , wherein said storing means has a clip database to registerfor each edit resultant clip said module identification information. 55.The editing system according to claim 54 , wherein said clip databaseincludes the link information indicating the link state of said clips inthe hierarchical structure in order to manage said edit resultant clipand said plurality of clips to be edited with the hierarchicalstructure.
 56. The editing system according to claim 55 , wherein saidplurality of processing modules have an edit module for editing saidplurality of clips to be edited, a composite module for composing saidplurality of clips to be edited, and a special effect module forapplying the special effects to said plurality of clips to be edited.57. The editing system according to claim 56 , further comprising: userinterface means composed of a graphical user interface for editprocessing corresponding to said edit module, a graphical user interfacefor composite processing corresponding to said composite module, and agraphical user interface for special effect processing corresponding tosaid special effect module; and display means for displaying saidgraphical user interface for edit processing, said graphical userinterface for composite processing, and said graphical user interfacefor special effect processing on a display; said control means wherein:identifies the processing module corresponding to said selected editresultant clip based on the module identification information registeredin said clip database; and starts up the processing module correspondingto said identified processing module and controls said display means todisplay the graphical user interface of the processing modulecorresponding to said identified processing module.
 58. The editingsystem according to claim 57 , wherein said clip database has editingpoint data showing a plurality of editing points specified in producingsaid edit resultant clip and image processing data showing the contentof the image processing applied to the video data of said clip to beedited to produce said edit resultant clip.
 59. The editing systemaccording to claim 58 , wherein said control means controls the imageprocessing timing of said image processing means based on said editingpoint data registered in said clip database, and controls the imageprocessing operation of said image processing means based on said imageprocessing data registered in said clip database.
 60. The editing systemaccording to claim 58 , wherein said editing point data is datarepresenting the edit start point and the edit end point of said clip tobe edited, and data representing the change point of said imageprocessing data applied to the video data of said edit resultant clip.61. The editing system according to claim 58 , wherein said imageprocessing data consists of edit processing data indicating the contentof the image processing corresponding to the edit processing specifiedby said edit module, the composite processing data indicating thecontent of the image processing corresponding to the compositeprocessing specified by said composite module, and the special effectprocessing data indicating the content of the image processingcorresponding to the special effect processing specified by said specialeffect module.
 62. The editing system according to claim 61 , whereinsaid edit data consists of edit processing identification dataindicating the type of edit processing set by said edit module and aplurality of edit processing parameters corresponding to the editprocessing.
 63. The editing system according to claim 62 , wherein saidedit processing parameters are registered in said clip database so as tocorrespond to said editing point specified in said edit resultant clip.64. The editing system according to claim 63 , wherein said controlmeans controls said image processing means so as to perform on the videodata of said clip to be edited the image processing in accordance withsaid edit processing parameters corresponding to said editing point at atiming in accordance with said editing point.
 65. The editing systemaccording to claim 63 , wherein: the editing point specified for saidedit resultant clip includes the first editing point and the secondediting point; said edit processing parameters include the first editprocessing parameter set to a timing corresponding to said first editingpoint and the second edit processing parameter set to a timingcorresponding to said second editing point; and said control meanscontrols said image processing means so as to perform the imageprocessing in accordance with said first edit parameter on the videodata of said clip to be edited at a timing of said first editing point,and controls said image processing means so as to perform the imageprocessing in accordance with said second edit parameter on the videodata of said clip to be edited at a timing of said second editing point.66. The editing system according to claim 65 , wherein said controlmeans controls said image processing means so as to perform the imageprocessing in accordance with the interpolation parameter interpolatedbetween said first edit parameter and said second edit parameter on thevideo data of said clip to be edited during the period from said firstediting point to said second editing point.
 67. The editing systemaccording to claim 62 , wherein said control means controls displaymeans to display the cell showing the edit section of said clip to beedited and the change of said edit processing parameters specified forsaid clip to be edited, which correspond to the time axis direction. 68.The editing system according to claim 62 , wherein said control meanscontrols said display means to display said plurality of edit processingparameters set for said selected edit resultant clip on said display asa part of said graphical user interface for edit processing, based onthe information registered in said clip database.
 69. The editing systemaccording to claim 68 , wherein said control means controls said displaymeans to display said edit parameter so as to correspond to each editingpoint, in order to visually know the change in the time axis directionof said plurality of edit processing parameters, based on said editingpoint data and said image processing data of said selected editresultant clip.
 70. The editing system according to claim 62 , whereinwhile the first processing module is being started up to produce thefirst edit: resultant clip, when the second edit resultant clip linkedas a lower clip of said first edit resultant clip is selected, saidcontrol means refers said link: information, said module identificationinformation, said editing point data, and said image processing datawhich are registered as the information relating to said second editresultant clip of said clip database, starts up the second processingmodule corresponding to said second edit resultant clip based on saidmodule identification code, and controls, based on said linkinformation, said editing point data, and said image processing data,said display means to display the cell representing the edit section ofclip linked to the lower position of said second edit resultant clip soas to associate with the editing point of said editing point data, andto display each processing parameter of said image processing datacorresponding to said second processing module so as to associate withthe editing point of said editing point data.
 71. An editing system forediting a plurality of clips to be edited, comprising: editing means,which is composed of a plurality of processing modules for editing saidclips to be edited, for applying to a plurality of clips to be editedthe edit processing corresponding to the processing module selectedamong from the plurality of processing modules to produce edit resultantclip; display means for displaying the graphical user interfacecorresponding to said plurality of processing modules on a display;storing means for storing the image processing data indicating thecontent of the image processing applied by the edit processing performedby said editing means to the video data of said clip to be edited, so asto correspond to said edit resultant clip; and control means forcontrolling said display means to display said image processing datastored in said storing means which corresponds to said selected editresultant clip on a display as a part of said graphical user interface,when said edit resultant clip is selected.
 72. The editing systemaccording to claim 71 , wherein said storing means has a clip databaseto register for each edit resultant clip said image processing data. 73.The editing system according to claim 72 , wherein said plurality ofprocessing modules have an edit module for editing said plurality ofclips to be edited, a composite module for composing said plurality ofclips to be edited, and a special effect module for applying the specialeffects to said plurality of clips to be edited.
 74. The editing systemaccording to claim 73 , further comprising image processing means forapplying to the video data of said clip to be edited the imageprocessing respectively corresponding to said edit module, saidcomposite module, and said special effect module.
 75. The editing systemaccording to claim 74 , wherein said clip database has the moduleidentification information indicating that which of processing modulesis said edit resultant clip produced from.
 76. The editing systemaccording to claim 75 , wherein: said graphical user interface iscomposed of a graphical user interface for edit processing correspondingto said edit module, a graphical user interface for composite processingcorresponding to said composite module, and a graphical user interfacefor special effect processing corresponding to said special effectmodule; and said control means identifies the processing modulecorresponding to said selected edit resultant clip based on the moduleidentification information registered in said clip database; and startsup the processing module corresponding to said identified processingmodule and controls said display means to display the graphical userinterface of the processing module corresponding to said identifiedprocessing module.
 77. The editing system according to claim 76 ,wherein said clip database has editing point data showing a plurality ofediting points specified in producing said edit resultant clip and imageprocessing data showing the contents of the image processing performedon the video data of said clip to be edited to produce said editresultant clip.
 78. The editing system according to claim 77 , whereinsaid control means controls the image processing timing of said imageprocessing means based on said editing point data registered in saidclip database, and controls the image processing operation of said imageprocessing means based on said image processing data registered in saidclip database.
 79. The editing system according to claim 77 , whereinsaid editing point data is data representing the edit start point andthe edit end point of said clip to be edited, and data representing thechange point of said image processing data applied to the video data ofsaid edit resultant clip.
 80. The editing system according to claim 77 ,wherein said image processing data consists of edit processing dataindicating the content of the image processing corresponding to the editprocessing specified by said edit module, the composite processing dataindicating the content of the image processing corresponding to thecomposite processing specified by said composite module, and the specialeffect processing data indicating the content of the image processingcorresponding to the special effect processing specified by said specialeffect module.
 81. The editing system according to claim 80 , whereinsaid edit data consists of edit processing identification dataindicating the type of edit processing set by said edit module and aplurality of edit processing parameters corresponding to the editprocessing.
 82. The editing system according to claim 81 , wherein saidedit processing parameters are registered in said clip database so as tocorrespond to said editing point specified in said edit resultant clip.83. The editing system according to claim 82 , wherein said controlmeans controls said image processing means so as to perform on the videodata of said clip to be edited the image processing in accordance withsaid edit processing parameters corresponding to said editing point at atiming in accordance with said editing point.
 84. The editing systemaccording to claim 82 , wherein: the editing point specified for saidedit resultant clip includes the first editing point and the secondediting point; said edit processing parameters include the first editprocessing parameter set to a timing corresponding to said first editingpoint and the second edit processing parameter set to a timingcorresponding to said second editing point; and said control meanscontrols said image processing means so as to perform the imageprocessing in accordance with said first edit parameter on the videodata of said clip to be edited at a timing of said first editing point,and controls said image processing means so as to perform the imageprocessing in accordance with said second edit parameter on the videodata of said clip to be edited at a timing of said second editing point.85. The editing system according to claim 84 , wherein said controlmeans controls said image processing means so as to perform the imageprocessing in accordance with the interpolation parameter interpolatedbetween said first edit parameter and said second edit parameter on thevideo data of said clip to be edited during the period from said firstediting point to said second editing point.
 86. The editing systemaccording to claim 81 , wherein said control means controls displaymeans to display the cell showing the edit section of said clip to beedited and the change of said edit processing parameters specified forsaid clip to be edited, which correspond to the time axis direction. 87.The editing system according to claim 81 , wherein said control meanscontrols said display means to display said plurality of edit processingparameters set for said selected edit resultant clip on said display asa part of said graphical user interface for edit processing, based onthe information registered in said clip database.
 88. The editing systemaccording to claim 87 , wherein said control means controls said displaymeans to display said edit parameter so as to correspond to each editingpoint, in order to visually know the change in the time axis directionof said plurality of edit processing parameters, based on said editingpoint data and said image processing data of said selected editresultant clip.
 89. An editing system for editing a plurality of clipsto be edited, comprising: editing means, which is composed of aplurality of processing modules for editing the clips to be edited, forapplying to said clips to be edited the edit processing corresponding tothe processing module selected among from the plurality of processingmodules to produce edit resultant clip; managing means for managing saidedit resultant clip and said plurality of clips to be edited with thehierarchical structure in order to show that which of clips to be editedis said edit resultant clip produced from; and display means fordisplaying on a display a graphical user interface including a treewindow for showing the link state of a plurality of clips managed bysaid managing means with the hierarchical structure, and a time linewindow showing the edit section of said clip to be edited on the timeaxis.
 90. The editing system for editing a plurality of clips to beedited, comprising: editing means which is composed an edit module forproducing the edit resultant clip by applying the edit processing tosaid clips to be edited, a composite module for producing the editresultant clip by applying the composite processing to said clips to beedited, and a special effect module for producing the edit resultantclip by applying the special effect processing to said clips to beedited; user interface means composed of a graphical user interface foredit processing corresponding to said edit module, a graphical userinterface for composite processing corresponding to said compositemodule, and a graphical user interface for special effect processingcorresponding to said special effect module; and display control meansfor displaying said graphical user interface for edit processing on adisplay when the edit processing is performed by said edit module, fordisplaying said graphical user interface for composite processing on adisplay when the edit processing is performed by said composite module,and for displaying said graphical user interface for edit processing ona display when the edit processing is performed by edit module.
 91. Anediting system for editing a clip to be edited, comprising: editingmeans for producing the edit resultant clip by applying the editprocessing specified by an edit operator on said clip to be edited;managing means for managing, with the hierarchical structure, the clipused by said edit processing of said editing means and the clip producedby said edit processing; and control means for controlling said editingmeans based on the information managed by said managing means.
 92. Anediting system for producing the edit resultant clip by editing thesupplied clip, comprising: editing means for producing the editresultant clip by applying the edit processing specified by an editoperator to the clip to be edited which is edit-processed; managingmeans for managing each clip with the hierarchical structure by linkingsaid clip to be edited to said edit resultant clip as a lower clip, orby linking said edit resultant clip to said clip to be edited as a upperclip; and control means for controlling said editing means based on theinformation managed by said managing means.
 93. An editing system forediting the supplied clip, comprising: editing means for applying theedit processing to the supplied clip; managing means for managing allclips used or produced by said editing means, with the hierarchicalstructure which is expressed by the up and low relation, by linking eachother, regarding the clip to be edit-processed in said edit processingas a lower clip and the clip produced by the edit processing in saidedit processing as an upper clip; and control means for controlling saidediting means based on the information managed by said managing means.94. An editing method for producing the edit resultant clip from aplurality of clips to be edited, comprising the steps of: applying theedit processing corresponding to the processing module selected amongfrom a plurality of processing modules for editing a clip to be edited,to produce the edit resultant clip; and managing said edit resultantclip and said clips to be edited with the hierarchical structure, inorder to indicate that which of clips to be edited is said editresultant clip produced from.
 95. The editing method according to claim94 , wherein said plurality of clips are managed by the clip database inwhich the information relating to said plurality of clips
 100. Theediting method according to claim 98 , wherein said clip database hasthe module identification information representing that which ofprocessing modules is said edit resultant clip produced from.
 101. Theediting method according to claim 100 , wherein said control meansstarts up the processing module corresponding to the edit resultant clipspecified by an edit operator based on said module identificationinformation stored in said clip database.
 102. The editing methodaccording to claim 100 , wherein said clip database has editing pointdata showing a plurality of editing points specified in producing saidedit resultant clip and image processing data showing the content of theimage processing applied to the video data of said clip to be edited toproduce said edit resultant clip.
 103. The editing method according toclaim 102 , wherein the image processing timing applied to said clip tobe edited is controlled based on said editing point data registered insaid clip database, and the image processing operation applied to saidclip to be edited is controlled based on said image processing dataregistered in said clip database.
 104. The editing method according toclaim 102 , wherein said editing point data is data representing theedit start point and the edit end point of said clip to be edited, anddata representing the change point of said image processing data appliedto the video data of said edit resultant clip.
 105. The editing methodaccording to claim 102 , wherein said image processing data consists ofedit processing data indicating the content of the image processingcorresponding to the edit processing specified by said edit module, thecomposite processing data indicating the content of the image processingcorresponding to the composite processing specified by said compositemodule, and the special effect processing data indicating the content ofthe image processing corresponding to the special effect processingspecified by said special effect module.
 106. The editing methodaccording to claim 105 , wherein said edit processing data consists ofedit processing identification data indicating the type of editprocessing set by said edit module and a plurality of edit processingparameters corresponding to the edit processing.
 107. The editing methodaccording to claim 106 , wherein said edit processing parameters areregistered in said clip database so as to correspond to said editingpoint specified in said edit resultant clip.
 108. The editing methodaccording to claim 107 , wherein said control means performs on thevideo data of said clip to be edited the image processing in accordancewith said edit processing parameters which correspond to said editingpoint at a timing in accordance with said editing point.
 109. Theediting method according to claim 107 , wherein: the editing pointspecified for said edit resultant clip includes the first editing pointand the second editing point; said edit processing parameters includethe first edit processing parameter set to a timing corresponding tosaid first editing point and the second edit processing parameter set toa timing corresponding to said second editing point; and said imageprocessing means is controlled so as to perform the image processing inaccordance with said first edit parameter on the video data of said clipto be edited at a timing of said first editing point, and is controlledso as to perform the image processing in accordance with said secondedit parameter on the video data of said clip to be edited at a timingof said second editing point.
 110. The editing method according to claim109 , wherein the image processing in accordance with the interpolationparameter interpolated between said first edit parameter and said secondedit parameter is applied to the video data of said clip to be editedduring the period from said first editing point to said second editingpoint.
 111. The editing system according to claim 106 , wherein the cellshowing the edit section of said clip to be edited and the change ofsaid edit processing parameters specified for said clip to be edited aredisplayed so as to correspond to the time axis direction.
 112. Theediting method according to claim 102 , wherein a new edit resultantclip is produced instead of the edit resultant clip before modificationin response to the instruction from an edit operator to modify said editresultant clip, and all clips linked to the upper position of the editresultant clip before modification are searched based on said linkinformation of said clip database to make the searched clips disable.113. The editing method according to claim 112 , wherein: theinformation relating to said new edit resultant clip is registered insaid clip database with the clip identification code or clip namerepresenting said edit resultant clip before modification; and theinformation relating to said edit resultant clip before modification isregistered in said clip database with the clip identification code orclip name which is different from the clip identification code or clipname representing said edit resultant clip before modification.
 114. Theediting method according to claim 113 , wherein said database has theidentification flag indicating whether said each clip is enable ordisable.
 115. The editing method according to claim 114 , whereinre-execution processing is performed in order to make the edit resultantclip which has been made disable by said modification processing enablein response to the instruction from an edit operator.
 116. The editingmethod according to claim 115 , wherein said re-execution processingincludes: search process for referring said link information and saididentification flag of said clip database to search the edit resultantclip to be re-executed among from said disable edit resultant clips; andproduction process for producing a new video data corresponding to saidsearched edit resultant clip among from the video data of all lowerclips linked to the lower position of the edit resultant: clip searchedby said search process.
 117. The editing method according to claim 116 ,wherein in said production process, a new edit resultant clip isproduced instead of said searched disable edit resultant clip, from saidnewly produced video data, said link information, said editing pointdata, and said image processing data relating to said searched editresultant clip registered in said clip database.
 118. The editing methodaccording to claim 117 , wherein said edit resultant clip newly producedis registered in said clip database with the clip identification code orclip name representing said searched disable edit resultant clip, andsaid searched disable edit resultant clip is registered in said clipdatabase with the clip identification code or clip name which isdifferent from the clip identification code or clip name representingsaid researched disable edit resultant clip.
 119. The editing methodaccording to claim 116 , wherein said search process and said productionprocess are repeated until all clips managed with the hierarchicalstructure become enable.
 120. The editing method according to claim 116, wherein said search process searches the edit resultant clip which hasthe lower clips being all enable among said disable edit resultant clipsand which is at the lowest position among said clips managed with thehierarchical structure, to be performed with the re-execution.
 121. Theediting method according to claim 116 , wherein said production processperforms the image processing on the video data of the clip to be linkedlowly based on said editing point data and said image processing datacorresponding to said searched disable edit resultant clip, so as toproduce said new video data.
 122. An editing method of editing aplurality of clips to be edited, comprising the steps of: applying to aplurality of clips to be edited the edit processing corresponding to theprocessing module selected among from the plurality of processingmodules to produce edit resultant clip; storing the moduleidentification information indicating that which of processing modulesis said edit resultant clip produced by using from; and starting up theprocessing module corresponding to said edit resultant clip based onsaid stored module identification data, when said edit resultant clip isselected.
 123. The editing method according to claim 122 , wherein saidmodule identification information is stored by a clip database in whichthe information relating to said plurality of clips are registered foreach clip.
 124. The editing method according to claim 123 , wherein saidclip database includes the link information indicating the link state ofeach clip in the hierarchical structure in order to manage said editresultant clip and said plurality of clips to be edited with thehierarchical structure.
 125. The editing method according to claim 124 ,wherein said plurality of processing modules comprise an edit module forediting said plurality of clips to be edited, a composite module forcomposing said plurality of clips to be edited, and a special effectmodule for applying the special effects to said plurality of clips to beedited.
 126. The editing method according to claim 125 , wherein: theprocessing module corresponding to said selected edit resultant clip isidentified based on the module identification information registered insaid clip database; and the processing module corresponding to saididentified processing module is started up and the graphical userinterface of the processing module corresponding to said identifiedprocessing module is displayed.
 127. An editing method of editing aplurality of clips to be edited, comprising the steps of: displaying ona display the graphical user interface corresponding to the processingmodule for editing the clip to be edited; applying the edit processingcorresponding to said processing module to said plurality of clips to beedited to produce the edit resultant clip; storing the image processingdata indicating the content of image processing applied to the videodata of said clip to be edited by the edit processing performed by saidediting means, so as to correspond to said edit resultant clip; anddisplaying on a display said image processing data stored in saidstoring means which corresponds to said selected edit resultant clip asa part of said graphical user interface, when said edit resultant clipis selected.
 128. The editing method according to claim 127 , whereinsaid image processing data is stored by the clip database in which theinformation relating to said plurality of clips is registered for eachclip.
 129. The editing method according to claim 128 , wherein saidplurality of processing modules comprise, at least, an edit module forediting said plurality of clips to be edited, a composite module forcomposing said plurality of clips to be edited, and a special effectmodule for applying the special effects to said plurality of clips to beedited.
 130. The editing method according to claim 129 , wherein theimage processing respectively corresponding to said edit module, saidcomposite module, and said special effect module is applied to the videodata of said clip to be edited based on said image processing dataregistered in said clip database.
 131. The editing method according toclaim 130 , wherein said clip database has the module identificationinformation indicating that which of processing modules is said editresultant clip produced from.
 132. The editing method according to claim131 , wherein said graphical user interface consists of a graphical userinterface for edit processing corresponding to said edit module, agraphical user interface for composite processing corresponding to saidcomposite module, and a graphical user interface for special effectprocessing corresponding to said special effect module; and theprocessing module corresponding to said selected edit resultant clip isidentified based on the module identification information registered insaid clip database, the processing module corresponding to saididentified processing module is started up, and the graphical userinterface of the processing module corresponding to said identifiedprocessing module is displayed.
 133. An editing method of editing theclip to be edited, comprising the steps of: applying the edit processingspecified by an operator to said clip to be edited to produce the editresultant clip; registering the information for managing with thehierarchical structure the clip used in said edit processing of saidediting means and the clip produced by said edit processing; andcontrolling said editing means based on said registered information.134. An editing method of editing the supplied clip to produce the editresultant clip, comprising the steps of: applying the edit processingspecified by an edit operator to the clip to be edited which is to beedit-processed to produce the edit resultant clip; and managing eachclip with the hierarchical structure by lining said clip to be edited tosaid edit resultant clip as a lower clip or by linking said editresultant clip to said clip to be edited as an upper clip.
 135. Anediting method of editing the supplied clip, comprising the steps of:applying the edit processing to the supplied clip; and managing allclips used and produced by said edit processing with the hierarchicalstructure which is expressed by the up and low relation by lining eachother, regarding said clip to be edited as a lower clip and said clip tobe produced by said edit processing as an upper clip.
 136. A clipmanagement device for an editing device editing the supplied clip,comprising: editing means for applying the edit processing to thesupplied clip; and managing means for managing with the hierarchicalstructure said clip to be edited and the clip produced by said editprocessing by linking each other, regarding said clip to be edited insaid edit processing as a lower clip and the clip produced by said edit:processing as an upper clip.
 137. A clip management method for anediting device editing the supplied clip, comprising the steps of:applying the first edit processing specified by an edit operator to theclip to be edited which is to be edit-processed, to produce the firstedit resultant clip; managing with the hierarchical structure said clipto be edited and said first edit resultant clip by linking said clip tobe edited to said edit resultant clip as a lower clip or linking saidedit resultant clip to said clip to be edited as an upper clip; applyingthe second edit processing specified by an edit operator to said firstedit resultant clip, to produce the second edit resultant clip; andmanaging with the hierarchical structure said clip to be edited, saidfirst edit resultant clip, and said second edit resultant clip, bylinking said first edit resultant clip to said second edit resultantclip as a lower clip or linking said second edit resultant clip to saidfirst edit resultant clip as an upper clip.
 138. An editing system forediting the clip to be edited, comprising: editing means for applyingthe edit processing specified by an edit operator to the clip to beedited to produce the edit resultant clip; managing means for managingwith the hierarchical structure all clips by linking said edit resultantclip and said clip to be edited so as to be in the up and low relation;and control means for controlling said managing means, when the contentof said edit resultant clip is modified, so as to make all clips linkedto the upper position of said modified edit resultant clip disable basedon the information managed by said managing means.
 139. An editingmethod for editing the clip to be edited, comprising the steps of:applying the edit processing specified by an edit operator to the clipto be edited to produce the edit resultant clip; managing with thehierarchical structure all clips by linking said edit resultant clip andsaid clip to be edited so as to be in the up and low relation eachother; and when the content of said edit resultant clip is modified,making all clips linked to the upper position of said modified editresultant clip disable.
 140. A clip managing method applied for anediting device editing the clip to be edited, comprising the steps of:applying the edit processing specified by an edit operator to the clipto be edited to produce the edit resultant clip; managing with thehierarchical structure all clips by linking said edit resultant clip andsaid clip to be edited so as to be in the up and low relation eachother; and when the content of said edit resultant clip is modified,making all clips linked to the upper position of said modified editresultant clip disable.
 141. An editing system for editing the clip tobe edited, comprising: editing means for applying the edit processingspecified by an edit operator to said clip to be edited to produce theedit resultant clip; managing means for managing with the hierarchicalstructure all clips by linking said edit resultant clip and said clip tobe edited so as to be in the up and low relation each other; and controlmeans, when the content of said edit resultant clip is modified, forcontrolling said editing means to newly produce said modified editresultant clip and all edit resultant clips linked to the upper positionof said modified edit resultant clip disable, based on the informationrelating to the hierarchical structure managed by said managing means.142. An editing method for editing the clip to be edited, comprising thesteps of: applying the edit processing specified by an edit operator tosaid clip to be edited to produce the edit resultant clip; managing withthe hierarchical structure all clips by linking said edit resultant clipand said clip to be edited so as to be in the up and low relation eachother; and newly producing said modified edit resultant clip and alledit resultant clips linked to the upper position of said modified editresultant clip.